-- Logs begin at Thu 2022-09-15 06:48:05 UTC, end at Thu 2022-09-15 07:57:12 UTC. -- Sep 15 07:29:56.774389 dv-cinder-824149-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 07:29:56.782951 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 07:29:56.784911 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 07:29:56 2022] *** Sep 15 07:29:56.784911 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 07:29:56.784911 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 07:29:56.784911 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: nodename: dv-cinder-824149-6-iscsi Sep 15 07:29:56.784911 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: machine: x86_64 Sep 15 07:29:56.784911 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: clock source: unix Sep 15 07:29:56.784911 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: pcre jit disabled Sep 15 07:29:56.784911 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: detected number of CPU cores: 4 Sep 15 07:29:56.784911 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: current working directory: / Sep 15 07:29:56.784911 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: detected binary path: /usr/bin/uwsgi-core Sep 15 07:29:56.785643 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: your processes number limit is 47680 Sep 15 07:29:56.785643 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: your memory page size is 4096 bytes Sep 15 07:29:56.785643 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: detected max file descriptor number: 2048 Sep 15 07:29:56.785643 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: lock engine: pthread robust mutexes Sep 15 07:29:56.785643 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: thunder lock: enabled Sep 15 07:29:56.785643 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 07:29:56.785643 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 07:29:56.831000 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: Python main interpreter initialized at 0x55b722a939c0 Sep 15 07:29:56.831000 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: python threads support enabled Sep 15 07:29:56.831000 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: your server socket listen backlog is limited to 100 connections Sep 15 07:29:56.831000 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: your mercy for graceful operations on workers is 90 seconds Sep 15 07:29:56.831399 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 07:29:56.831399 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: *** Operational MODE: preforking *** Sep 15 07:29:56.831674 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: *** uWSGI is running in multiple interpreter mode *** Sep 15 07:29:56.831674 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: spawned uWSGI master process (pid: 106038) Sep 15 07:29:56.831870 dv-cinder-824149-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 07:29:56.832698 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: spawned uWSGI worker 1 (pid: 106039, cores: 1) Sep 15 07:29:56.832809 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: spawned uWSGI worker 2 (pid: 106040, cores: 1) Sep 15 07:29:56.833311 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 07:29:57.501808 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 07:29:57.505044 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 07:29:58.595290 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:29:58.595290 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: from cryptography.utils import int_from_bytes Sep 15 07:29:58.595876 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:29:58.595876 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: from cryptography.utils import int_from_bytes Sep 15 07:29:58.621752 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:29:58.621752 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: from cryptography.utils import int_from_bytes Sep 15 07:29:58.622223 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:29:58.622223 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: from cryptography.utils import int_from_bytes Sep 15 07:30:01.084641 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 07:30:01.085548 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 07:30:01.085548 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 07:30:01.099258 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 07:30:01.099258 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 07:30:01.099258 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.099258 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.099258 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.099258 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.099258 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.099680 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 07:30:01.100060 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.100129 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 07:30:01.100201 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.100271 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 07:30:01.100344 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.100344 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.100458 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 07:30:01.100521 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.100582 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 07:30:01.100656 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.100733 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.100797 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824149-6-iscsi {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.100867 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.100930 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.100998 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101062 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101131 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101196 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101259 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101321 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101382 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101454 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101518 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101603 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101673 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101736 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101811 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101811 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.101941 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.102024 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.102088 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.102150 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824149-6-iscsi {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.102224 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.102288 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.102350 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.102411 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.102477 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.102551 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.102615 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.102929 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103003 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103074 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103137 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103215 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103280 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103341 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103409 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103409 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103534 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103534 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103660 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824149-6-iscsi {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103723 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103793 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103864 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103928 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.103990 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104052 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104113 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104187 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104258 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104329 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104399 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104463 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104535 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104610 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104674 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104737 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104806 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104887 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.104887 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105015 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824149-6-iscsi {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105080 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105153 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105217 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105280 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105280 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105392 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105392 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105518 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105834 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105907 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.105970 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.106032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.106116 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.106186 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.106255 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.106318 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.106430 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.106543 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.106658 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.106749 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.106875 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.106956 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107033 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107114 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107212 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107306 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107384 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107463 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107538 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107538 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107691 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107767 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107909 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.107997 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108082 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108240 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108320 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108402 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108485 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108485 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108642 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108726 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108808 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108884 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108965 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.108965 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.109112 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.109195 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.109272 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.109349 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.109423 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.109498 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.109607 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.109701 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.109793 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.109877 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.109960 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.110051 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.110129 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.110205 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.110280 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.110356 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.110505 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.111462 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.111612 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.111713 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.111790 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.111874 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.111958 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112043 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112121 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112195 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112278 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112361 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112446 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112524 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112599 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112675 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112758 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112836 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.112921 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.113005 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.113088 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.113165 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.113247 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.113324 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.113408 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.113492 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.113569 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.113664 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.113865 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.113954 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.114163 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.114250 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.114478 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.114570 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.114778 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.114872 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.115107 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.115200 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.115372 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.115466 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.115668 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.115764 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.115970 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.116067 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.116272 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.116363 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.116574 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.116671 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.116875 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.116960 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.117122 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.117210 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.117421 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.117515 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.117773 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.117868 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.118071 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.118159 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.118375 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.118515 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.118672 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.118764 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.118984 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.119079 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.119300 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.119388 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.119604 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.119692 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.119905 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.120002 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.120222 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.120317 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.120509 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.120603 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.120809 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.120902 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.121108 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.121196 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.121424 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.121516 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.121745 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.121840 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.122044 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.122139 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.122366 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.122472 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.122678 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.122775 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.122979 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.123066 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.123278 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.123362 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.123592 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.123683 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.123889 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.123990 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.124189 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.124274 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.124499 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.124591 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.124802 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.124886 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.125099 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.125183 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.125395 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.125479 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.125714 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.125804 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.126018 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.126131 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.126339 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.126444 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.126634 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.126719 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.126929 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.127015 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.127222 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.127315 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.127529 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.127622 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.127838 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.127930 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.128139 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.128231 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.128440 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.128525 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.128737 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.128821 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.129034 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.129128 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.129333 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.129420 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.129663 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.129753 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.129967 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.130054 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.130265 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.130364 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.130568 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.130666 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.130863 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.130958 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.131179 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.131265 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.131499 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.131608 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.131806 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.131933 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.132112 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.132211 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.132415 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.132512 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.132731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:30:01.132828 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.133035 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.133133 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.133349 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.133460 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.133685 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.133783 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.134011 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.134109 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.134326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.134433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.134641 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.134737 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.134955 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.135050 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.135263 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.135388 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.135573 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.135669 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.135897 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.136002 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.136202 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.136310 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.136508 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.136604 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.136812 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.136919 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.137129 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.137239 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.137444 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.137541 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.137790 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.137887 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.138105 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.138210 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.138411 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.138498 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.138716 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.138803 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.139020 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.139108 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.139336 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.139430 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.139647 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.139734 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.139955 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.140051 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.140264 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.140351 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.140568 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.140669 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.140886 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.140982 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.141190 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.141286 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.141493 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.141608 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.141849 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.141948 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.142153 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.142301 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.142453 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.142555 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.142777 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.142866 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.143088 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.143176 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.143406 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.143502 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.143714 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.143801 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.144018 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.144103 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.144329 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.144428 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.144632 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.144725 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.144936 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.145031 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.145241 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.145336 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.145538 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.145648 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.145861 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.145949 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.146161 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.146251 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.146464 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.146559 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.146763 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.146851 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.147076 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.147161 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.147397 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.147503 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.147696 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.147783 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.148013 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.148101 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.148314 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.148410 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.148619 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.148707 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.148923 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.149011 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.149224 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.149318 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.149524 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.149630 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.149854 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.149950 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.150155 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.150249 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.150455 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.150554 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.150771 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.150857 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.151072 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.151159 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.151371 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.151472 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.151690 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.151786 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.151990 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.152131 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.152293 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.152389 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.152597 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.152690 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.152900 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.152987 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.153202 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.153304 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.153506 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.153633 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.153833 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.153921 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.154135 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.154225 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.154443 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.154530 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.154747 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.154833 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.155050 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.155139 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.155371 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.155460 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.155668 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.155754 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.155972 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.156060 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.156285 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.156380 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.156593 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.156679 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.156893 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.156982 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.157196 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.157869 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.158036 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.158248 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.158366 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.158582 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.158768 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.158899 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.159071 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.159210 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.159371 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.159543 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.159670 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.159872 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.159967 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.160178 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.160266 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.160501 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.160597 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.160824 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.160921 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.161130 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.161216 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.161427 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.161517 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.161759 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.161861 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.162064 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.162147 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.162369 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.162468 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.162675 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.162772 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.162982 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.163073 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.163286 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.163372 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.163589 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.163686 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.163891 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.163978 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.164193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.164281 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.164495 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.164591 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.164814 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.164900 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.165120 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.165206 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.165418 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.165513 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.165744 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.165835 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.166045 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.166132 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.166348 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.166436 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.166659 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.166746 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.166963 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.167057 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.167281 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.167365 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.167584 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.167670 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.167895 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.167982 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.168195 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.168283 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.168502 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.168590 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.168809 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.168903 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.169119 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.169206 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.169426 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.169513 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.169761 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.169862 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.170079 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.170176 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.170368 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.170455 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.170677 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.170811 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.170984 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.171094 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.171284 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.171370 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.171588 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.171685 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.171902 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.171999 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.172203 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.172351 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.172509 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.172604 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.172811 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.172898 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.173762 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.173877 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.174072 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.174180 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.174392 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.174479 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.174702 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.174797 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.175016 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.175105 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.175324 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.175418 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.175631 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.175725 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.175939 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.176029 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.176249 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.176346 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.176563 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.176650 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.176870 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.176958 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.177181 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.177267 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.177485 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.177598 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.177808 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.177895 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.178108 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.178197 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.178415 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.178510 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.178724 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.178823 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.179030 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.179116 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.179333 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.179432 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.179633 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.179720 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.179940 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.180028 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.180245 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.180348 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.180543 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.180630 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.180847 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.180934 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.181155 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.181256 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.181465 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.181560 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.181791 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.181878 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.182093 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.182188 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.182399 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.182487 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.182697 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.182791 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.182997 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.183100 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.183305 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.183401 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.183604 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.183705 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.183901 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.183991 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.184198 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.184284 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.184498 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.184592 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.184800 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.184887 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.185107 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.185202 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.185405 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.185499 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.185739 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.185830 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.186053 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.186148 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.186355 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.186450 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.186663 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.186749 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.186968 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.187054 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.187270 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.187378 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.187586 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.187673 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.187893 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.187980 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.188193 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.188281 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.188496 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.188599 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.188823 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.188909 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.189172 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.189266 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.189477 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.189642 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.189817 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.190007 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.190137 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.190315 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.190446 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.190624 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.190759 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.190932 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.191069 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.191237 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.191362 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.191542 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.191681 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.191855 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.191991 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.192303 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.192414 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.192614 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.192736 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.192969 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.193074 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.193231 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.193344 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.193539 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.193708 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.193883 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.194021 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.194189 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.194345 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.194497 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.194667 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.194806 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.194974 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.195108 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.195272 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.195415 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.195577 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.195728 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.195877 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.196176 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.196289 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.196482 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.196619 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.196781 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.196933 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.197079 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.197249 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.197377 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.197604 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.197706 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.197928 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.198024 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.198257 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.198343 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.198562 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.198722 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.198872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.199012 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.199148 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.199304 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.199445 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.199576 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.199721 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.199858 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.200015 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.200154 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.200331 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.200478 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.200632 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.200766 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.200902 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.201035 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.201204 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.201335 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.201480 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.201636 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.201824 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.201910 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.202139 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.202235 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.202428 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.202533 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.202734 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.202833 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.203042 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.203139 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.203347 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.203435 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.203655 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.203742 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.203954 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.204053 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.204300 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.204385 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.204616 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.204872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.204971 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.205061 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.205206 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.205301 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.205506 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.205646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.205862 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.205951 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.206165 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.206260 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.206466 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.206560 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.206783 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.206874 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.207071 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.207157 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.207368 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.207455 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.207670 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.207775 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.207967 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.208054 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.208275 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.208363 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.208575 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.208671 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.208873 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.208960 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.209168 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.209263 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.209468 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.209561 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.209824 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.209924 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.210085 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.210182 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.210386 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.210497 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.210685 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.210772 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.210987 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.211082 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.211284 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.211373 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.211582 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.211668 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.211879 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.211974 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.212178 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.212264 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.212479 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.212575 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.212777 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.212891 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.213077 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.213173 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.213379 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.213480 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.213700 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.213799 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.213996 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.214084 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.214299 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.214394 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.214595 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.214680 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.214891 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.214976 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.215190 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.215275 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.215488 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.215574 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.215787 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.215880 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.216084 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.216177 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.216385 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.216470 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.216680 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.216771 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.216981 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.217074 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.217280 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.217364 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.217601 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.217689 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.217896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.218005 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.218191 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.218277 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.218487 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.218580 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.218783 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.218882 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.219078 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.219163 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.219392 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.219484 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.219693 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.220280 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.220515 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.220624 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.220816 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.220943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.221116 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.221250 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.221459 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.221648 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.221783 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.221873 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.222138 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.222228 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.222439 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.222526 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.222744 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.222850 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.223046 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.223135 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.223348 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.223442 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.223650 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.223747 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.223957 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.224040 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.224260 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.224356 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.224558 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.224657 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.224862 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.224948 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.225159 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.225245 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.225454 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.225552 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.225774 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.225863 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.226089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.226192 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.226395 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.226497 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.226703 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.226803 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.227018 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.227106 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.227332 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.227427 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.227639 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.227978 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.228191 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.228286 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.228492 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.228580 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.228797 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.228884 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.229098 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.229183 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.229403 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.229497 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.229726 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.229816 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.230027 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.230112 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.230331 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.230425 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.230636 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.230723 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.230942 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.231035 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.231247 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.231340 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.231545 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.231631 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.231849 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.231949 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.232150 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.232238 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.232451 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.232534 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.232756 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.232859 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.233057 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.233143 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.233354 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.233439 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.233679 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.233784 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.233979 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.234067 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.234285 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.234373 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.234583 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.234680 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.234891 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.235000 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.235202 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.235297 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.235592 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.235779 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.235903 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.235992 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.236245 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.236342 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.236550 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.236658 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.236859 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.236946 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.237189 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.237304 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.237472 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.237569 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.237845 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.237939 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.238153 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.238247 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.238472 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.238568 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.238776 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.238888 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.239073 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.239202 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.239370 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.239513 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.239676 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.239821 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.239994 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.240123 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.240293 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.240433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.240590 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.240742 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.240891 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.241055 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.241207 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.241366 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.241504 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.241693 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.241844 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.242107 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.242251 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.242416 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.242555 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.242729 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.242842 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.243037 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.243248 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.243343 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.243555 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.243649 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.243860 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.243954 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.244177 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.244270 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.244493 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.244597 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.244806 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.244907 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.245102 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.245195 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.245410 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.245504 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.245733 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.245828 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.246049 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.246146 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.246367 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.246453 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.246673 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.246766 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.246982 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.247071 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.247281 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.247442 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.247598 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.247750 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.247912 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.248058 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.248219 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.248383 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.248536 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.248702 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.248942 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.249028 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.249258 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.249343 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.249562 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.249680 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.249895 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.249981 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.250213 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.250308 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.250512 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.250607 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.250812 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.250908 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.251665 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.251778 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.252013 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.252110 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.252313 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.252406 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.252633 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.252732 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.252935 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.253031 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.253239 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.253333 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.253543 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.253758 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.253858 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.254083 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.254176 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.254396 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.254482 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.254717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.254810 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.255031 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.255115 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.255329 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.255413 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.255632 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.255719 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.255942 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.256028 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.256245 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.256331 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.256543 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.256636 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.256860 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.256958 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.257159 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.257243 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.257455 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.257540 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.257776 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.257863 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.258076 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.258163 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.258376 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.258461 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.258677 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.258762 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.259001 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.259094 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.259301 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.259385 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.259621 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.259708 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.259924 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.260017 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.260241 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.260326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.260557 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.260649 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.260859 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.260953 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.261161 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.261246 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.261469 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.261554 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.261797 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.261896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.262096 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.262182 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.262394 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.262479 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.262696 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.262783 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.263000 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.263119 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.263302 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.263438 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.263601 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.263688 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.263901 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.263987 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.264198 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.264283 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.264492 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.264579 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.264789 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.264873 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.265105 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.265197 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.265404 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.265499 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.265744 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.265833 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.266048 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.266147 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.266346 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.266433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.266644 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.266782 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.267030 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.267125 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.267367 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.267518 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.267667 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.267828 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.267987 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.268134 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.268290 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.268442 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.268608 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.268746 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.268918 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.269053 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.269228 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.269365 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.269536 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.269676 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.269871 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.269980 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.270180 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.270302 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.270491 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.270612 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.270801 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.270915 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.271104 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.271222 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.271417 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.271524 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.271727 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.271865 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.272036 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.272169 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.272495 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.272587 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.272802 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.272890 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.273125 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.273223 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.273440 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.273535 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.273770 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.273865 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.274081 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.274167 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.274387 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.274482 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.274693 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.274786 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.274997 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.275082 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.275302 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.275396 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.275605 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.275692 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.275917 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.276014 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.276232 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.276319 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.276547 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.276632 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.276872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.277063 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.277185 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.277389 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.277497 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.277727 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.277827 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.278042 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.278139 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.278353 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.278464 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.278666 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.278776 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.278983 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.279068 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.279292 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.279379 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.279601 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.279689 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.279911 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.279998 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.280220 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.280306 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.280545 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.280630 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.280851 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.280937 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.281164 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.281251 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.281473 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.281572 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.281802 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.281888 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.282110 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.282196 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.282967 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.283075 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.283346 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.283566 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.283668 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.283942 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.284041 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.284260 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.284347 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.284568 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.284660 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.284879 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.284974 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.285191 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.285389 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.285504 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.285720 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.285845 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.286048 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.286157 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.286367 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.286468 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.286684 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.286780 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.286996 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.287083 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.287304 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.287389 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.287625 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.287719 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.287924 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.288011 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.288222 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.288317 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.288527 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.288624 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.288829 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.288915 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.289127 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.289221 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.289443 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.289618 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.289768 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.289943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.290087 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.290337 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.290479 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.290648 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.290777 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.290977 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.291171 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.291324 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.291513 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.291644 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.291829 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.291972 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.292147 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.292282 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.292471 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.292598 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.292780 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.292870 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.293081 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.293186 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.293396 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.293503 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.293720 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.293862 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.294020 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.294159 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.294329 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.294768 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.294768 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.294977 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.295110 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.295257 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.295257 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.295525 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.295659 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.295792 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.295928 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.296069 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.296203 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.296360 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.296495 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.296657 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.296804 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.296977 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.297109 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.297277 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.297428 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.297563 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.297685 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.297885 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.298033 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.298351 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.298486 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.298655 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.298795 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.298958 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.299099 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.299259 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.299414 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.299559 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.299731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.299860 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.300036 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.300160 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.300341 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.300463 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.300649 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.300763 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.300956 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.301069 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.301259 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.301409 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.301568 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.301749 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.301890 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.302048 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.302216 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.302366 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.302521 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.302665 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.302823 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.302962 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.303126 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.303276 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.303437 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.303579 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.303738 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.303895 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.304040 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.304202 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.304343 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.304509 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.304644 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.304849 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.304946 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.305160 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.305246 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.305530 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.305709 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.305857 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.306025 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.306165 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.306340 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.306515 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.306668 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.306821 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.306996 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.307116 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.307299 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.307433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.307599 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.307736 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.307899 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.308037 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.308215 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.308352 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.308521 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.308660 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.308826 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.308979 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.309129 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.309288 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.309431 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.309613 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.309759 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.309966 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.310056 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.310279 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.310374 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.310642 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.310817 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.310937 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.311155 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.311261 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.311477 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.311575 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.311812 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.311910 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.312111 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.312207 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.312411 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.312532 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.312719 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.312821 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.313022 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.313107 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.313344 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.313438 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.314204 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.314370 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.314516 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.314741 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.314830 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.315058 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.315152 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.315367 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.315454 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.315679 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.315774 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.315989 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.316083 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.316297 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.316383 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.316606 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.316700 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.316914 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.317014 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.317211 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.317309 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.317515 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.317851 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.317939 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.318160 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.318246 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.318466 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.318617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.318778 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.318872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.319097 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.319191 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.319417 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.319504 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.319730 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.319814 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.320037 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.320130 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.320352 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.320439 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.320658 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.320743 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.320967 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.321063 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.321275 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.321362 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.321602 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.321693 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.321916 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.322014 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.322232 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.322317 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.322536 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.322637 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.322841 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.322945 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.323142 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.323453 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.323538 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.323758 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.323853 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.324061 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.324147 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.324367 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.324485 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.324668 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.324776 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.324967 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.325064 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.325268 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.325364 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.325567 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.325741 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.325885 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.326043 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.326178 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.326321 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.326484 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.326601 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.326741 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.326906 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.327021 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.327237 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.327353 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.327558 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.327677 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.327865 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.327987 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.328251 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.328392 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.328493 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.328579 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.328764 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.328947 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.329045 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.329192 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.329997 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.330129 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.330314 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.330499 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.330739 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.330960 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.331117 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.331680 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.331792 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.331885 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.331979 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.332067 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.332153 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.332267 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.332386 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.332571 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.332697 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.332912 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.333021 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.333200 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.333289 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.333515 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.333643 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.333865 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.333954 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.334192 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.334309 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.334497 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.334602 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.334798 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.334896 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.335103 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.335196 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.335407 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.335502 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.335711 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.335805 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.336008 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.336100 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.336310 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.336410 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.336610 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.336699 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.336920 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.337020 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.337245 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.337345 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.337557 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.337676 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.337896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.338026 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.338202 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.338300 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.338506 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.338599 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.338816 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.338916 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.339123 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.339211 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.339432 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.339525 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.339738 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.339843 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.340046 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.340149 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.340352 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.340456 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.340663 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.340772 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.340972 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.341114 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.341282 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.341394 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.341606 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.341711 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.341923 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.342019 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.342233 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.342328 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.342558 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.342656 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.342865 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.342976 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.343172 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.343283 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.343493 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.343592 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.343808 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.343902 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.344128 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.344251 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.344468 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.344852 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.345011 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.345127 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.345319 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.345432 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.345526 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.345659 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.345739 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.345926 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.346200 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 07:30:01.346384 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.346623 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.346948 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.347268 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.347645 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.347896 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.348277 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.348756 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.349137 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.349546 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.349951 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.350231 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.350621 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.351036 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.351391 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.351744 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.352076 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.352456 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.353080 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.353389 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:30:01.353659 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 07:30:01.502386 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO dbcounter [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Registered counter for database nova_api Sep 15 07:30:01.507194 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO dbcounter [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Registered counter for database nova_api Sep 15 07:30:01.523461 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_db.sqlalchemy.engines [None req-f58731a9-62af-4226-a340-8785e61be98e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:30:01.528821 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG oslo_db.sqlalchemy.engines [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:30:01.529996 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writer thread running {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:30:01.535958 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writer thread running {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:30:01.587193 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.context [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72faee06-56dc-4608-aa3b-e80f5a9bf08f(cell1) {{(pid=106039) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 07:30:01.591073 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:30:01.591542 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:30:01.592411 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.context [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72faee06-56dc-4608-aa3b-e80f5a9bf08f(cell1) {{(pid=106040) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 07:30:01.593077 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:30:01.593824 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:30:01.594262 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:30:01.596946 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:30:01.597160 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG oslo_concurrency.lockutils [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:30:01.597655 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG oslo_concurrency.lockutils [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:30:01.598940 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO dbcounter [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Registered counter for database nova_cell0 Sep 15 07:30:01.599213 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG oslo_concurrency.lockutils [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:30:01.599930 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG oslo_concurrency.lockutils [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:30:01.600374 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG oslo_concurrency.lockutils [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:30:01.602372 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG oslo_concurrency.lockutils [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:30:01.603149 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO dbcounter [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Registered counter for database nova_cell1 Sep 15 07:30:01.604603 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO dbcounter [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Registered counter for database nova_cell0 Sep 15 07:30:01.608547 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO dbcounter [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Registered counter for database nova_cell1 Sep 15 07:30:01.610321 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_db.sqlalchemy.engines [None req-f58731a9-62af-4226-a340-8785e61be98e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:30:01.612174 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_db.sqlalchemy.engines [None req-f58731a9-62af-4226-a340-8785e61be98e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:30:01.615996 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG oslo_db.sqlalchemy.engines [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:30:01.617773 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writer thread running {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:30:01.617972 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG oslo_db.sqlalchemy.engines [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:30:01.623002 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writer thread running {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:30:01.625559 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writer thread running {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:30:01.625917 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writer thread running {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:30:01.768884 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO dbcounter [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Registered counter for database nova_cell0 Sep 15 07:30:01.775861 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO dbcounter [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Registered counter for database nova_cell0 Sep 15 07:30:01.776052 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_db.sqlalchemy.engines [None req-f58731a9-62af-4226-a340-8785e61be98e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:30:01.780826 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writer thread running {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:30:01.785356 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG oslo_db.sqlalchemy.engines [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:30:01.790224 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writer thread running {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:30:02.231014 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: WARNING keystonemiddleware.auth_token [None req-f58731a9-62af-4226-a340-8785e61be98e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 07:30:02.234445 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: WARNING keystonemiddleware.auth_token [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 07:30:02.239332 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: WARNING keystonemiddleware.auth_token [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 07:30:02.242233 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: WARNING keystonemiddleware.auth_token [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 07:30:02.589292 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: WARNING keystonemiddleware.auth_token [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 07:30:02.592611 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: WARNING keystonemiddleware.auth_token [None req-f58731a9-62af-4226-a340-8785e61be98e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 07:30:02.595293 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: WARNING keystonemiddleware.auth_token [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 07:30:02.598673 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: WARNING keystonemiddleware.auth_token [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 07:30:02.600504 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b722a939c0 pid: 106040 (default app) Sep 15 07:30:02.602758 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:30:02.604181 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-a97c77f1-227a-42f8-87ff-752a10064213 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002136 Sep 15 07:30:02.604448 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b722a939c0 pid: 106039 (default app) Sep 15 07:30:02.604797 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Thu Sep 15 07:30:02 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:31:28.060057 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:28.061297 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-f58731a9-62af-4226-a340-8785e61be98e None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Sep 15 07:31:28.061732 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:31:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:31:28.075023 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writing DB stats nova_api:SELECT=3 {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:28.076499 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writing DB stats nova_cell1:SELECT=3 {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:28.078930 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writing DB stats nova_cell0:SELECT=3 {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:28.080081 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:28.956965 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-eafc3e08-bf15-47f9-8547-137c1fdc67f9 admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:28.991454 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-eafc3e08-bf15-47f9-8547-137c1fdc67f9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.922751 Sep 15 07:31:28.992277 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 15 07:31:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:31:31.662280 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-f58731a9-62af-4226-a340-8785e61be98e None None] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:31.663552 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-f58731a9-62af-4226-a340-8785e61be98e None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001713 Sep 15 07:31:31.664111 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 2/4] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:31:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:31:32.109373 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-7ef6dc80-86e3-4ef7-b12b-af35355deb46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "ram": 256, "id": "c1"}} {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:32.219642 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-7ef6dc80-86e3-4ef7-b12b-af35355deb46 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.549621 Sep 15 07:31:32.220200 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 3/5] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 15 07:31:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 07:31:32.234496 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writing DB stats nova_api:SELECT=3 {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:32.235592 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writing DB stats nova_cell0:SELECT=3 {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:32.237611 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writing DB stats nova_cell1:SELECT=3 {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:32.238372 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:32.455071 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-7bd9fc59-ae6f-476c-a0a5-18b7f7de0d30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:32.577967 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-7bd9fc59-ae6f-476c-a0a5-18b7f7de0d30 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348904 Sep 15 07:31:32.578644 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 3/6] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 15 07:31:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:31:35.225725 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-7ef6dc80-86e3-4ef7-b12b-af35355deb46 admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:35.226743 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-7ef6dc80-86e3-4ef7-b12b-af35355deb46 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Sep 15 07:31:35.227136 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 4/7] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:31:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:31:35.894826 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-98ba1707-1b8a-483c-b7f3-9d79ed7ba204 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:36.001517 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-98ba1707-1b8a-483c-b7f3-9d79ed7ba204 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.768146 Sep 15 07:31:36.002330 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 4/8] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 15 07:31:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 07:31:36.014373 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-3ec8bd29-9325-4c6a-855a-662c64373cc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:36.145338 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-3ec8bd29-9325-4c6a-855a-662c64373cc2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.134501 Sep 15 07:31:36.146057 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 5/9] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 15 07:31:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:31:38.763008 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-98ba1707-1b8a-483c-b7f3-9d79ed7ba204 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:38.763882 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-98ba1707-1b8a-483c-b7f3-9d79ed7ba204 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 15 07:31:38.764300 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:31:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:31:39.184532 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-af3f9849-5065-45f1-ac64-a1d6495cd309 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "disk": 10, "ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:39.258406 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-af3f9849-5065-45f1-ac64-a1d6495cd309 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487897 Sep 15 07:31:39.259360 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 6/11] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 15 07:31:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:31:39.271744 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-15b5adf8-7f30-4c06-b3d1-c0c523d87629 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:39.397334 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-15b5adf8-7f30-4c06-b3d1-c0c523d87629 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129269 Sep 15 07:31:39.398178 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 6/12] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 15 07:31:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:31:42.053318 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-af3f9849-5065-45f1-ac64-a1d6495cd309 admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:42.055200 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-af3f9849-5065-45f1-ac64-a1d6495cd309 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002258 Sep 15 07:31:42.055604 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 7/13] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:31:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:31:42.480415 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-5ee9c97c-65d5-4e50-ad0d-b316ba230f3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "vcpus": 2, "disk": 10, "ram": 2048, "name": "ds2G"}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:42.566738 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-5ee9c97c-65d5-4e50-ad0d-b316ba230f3d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504780 Sep 15 07:31:42.567511 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 7/14] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 15 07:31:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:31:42.579634 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-80906e4a-a7b3-4e7b-973d-a617bcd4009c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:42.663533 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-80906e4a-a7b3-4e7b-973d-a617bcd4009c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086815 Sep 15 07:31:42.664614 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 8/15] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 15 07:31:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:31:45.451255 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-5ee9c97c-65d5-4e50-ad0d-b316ba230f3d admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:45.452272 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-5ee9c97c-65d5-4e50-ad0d-b316ba230f3d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 15 07:31:45.452681 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 8/16] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:31:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:31:45.888655 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-dcc82f8f-8ebb-4e33-a602-f6b6f42fdff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "swap": 0}} {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:45.951489 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-dcc82f8f-8ebb-4e33-a602-f6b6f42fdff8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492195 Sep 15 07:31:45.952079 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 9/17] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 15 07:31:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:31:45.965600 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-a8dd6906-44ac-41bf-bca2-39ce38804a16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:46.063137 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-a8dd6906-44ac-41bf-bca2-39ce38804a16 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100821 Sep 15 07:31:46.064274 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 9/18] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 15 07:31:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:31:49.357291 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-dcc82f8f-8ebb-4e33-a602-f6b6f42fdff8 admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:49.358367 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-dcc82f8f-8ebb-4e33-a602-f6b6f42fdff8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Sep 15 07:31:49.358776 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 10/19] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:31:49.843768 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-f24565eb-6b4e-4bdf-af45-1422bfd05e6e admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:49.869783 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-f24565eb-6b4e-4bdf-af45-1422bfd05e6e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.504054 Sep 15 07:31:49.870337 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 15 07:31:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:31:52.466146 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-dcc82f8f-8ebb-4e33-a602-f6b6f42fdff8 admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:52.467285 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-dcc82f8f-8ebb-4e33-a602-f6b6f42fdff8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 15 07:31:52.467694 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 11/21] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:31:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:31:52.874161 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-a803bc3d-4cd3-4adc-9409-b65535898346 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "swap": 0, "disk": 1, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:52.967073 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-a803bc3d-4cd3-4adc-9409-b65535898346 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.493113 Sep 15 07:31:52.967629 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 11/22] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 15 07:31:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:31:52.980745 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-6936906f-c22f-4a63-b817-f8e1447ebaf7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:53.078782 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-6936906f-c22f-4a63-b817-f8e1447ebaf7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101715 Sep 15 07:31:53.079402 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 12/23] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 15 07:31:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:31:55.681365 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-a803bc3d-4cd3-4adc-9409-b65535898346 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:55.683030 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-a803bc3d-4cd3-4adc-9409-b65535898346 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Sep 15 07:31:55.683432 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:31:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:31:56.095965 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-8ed01d09-9f33-418d-8f40-ff464f7f9f37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:56.177645 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-8ed01d09-9f33-418d-8f40-ff464f7f9f37 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.487404 Sep 15 07:31:56.178538 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 13/25] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 15 07:31:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:31:56.196006 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-f85539d7-b73d-4321-a65f-4d9ebe6bc6f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:56.311060 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-f85539d7-b73d-4321-a65f-4d9ebe6bc6f8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098452 Sep 15 07:31:56.311060 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 13/26] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 15 07:31:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:31:58.953543 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-8ed01d09-9f33-418d-8f40-ff464f7f9f37 admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:31:58.954588 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-8ed01d09-9f33-418d-8f40-ff464f7f9f37 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 15 07:31:58.955262 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:31:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:31:59.393385 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-22b5db13-84fb-44a8-8c2c-5845a5043ad0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:59.470498 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-22b5db13-84fb-44a8-8c2c-5845a5043ad0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.508219 Sep 15 07:31:59.471099 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 14/28] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 15 07:31:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:31:59.485517 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-1ce7f65d-5ff9-4d42-a0b8-e904f0a0ac00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:31:59.499791 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:31:59.609521 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-1ce7f65d-5ff9-4d42-a0b8-e904f0a0ac00 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129478 Sep 15 07:31:59.610431 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 15/29] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 15 07:31:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:32:02.321752 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-22b5db13-84fb-44a8-8c2c-5845a5043ad0 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:02.322778 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-22b5db13-84fb-44a8-8c2c-5845a5043ad0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Sep 15 07:32:02.323355 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:32:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:32:02.794263 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-5c5a66c0-69eb-43be-849a-21c0071474e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "vcpus": 4, "name": "m1.large"}} {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:32:02.871693 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-5c5a66c0-69eb-43be-849a-21c0071474e4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.540821 Sep 15 07:32:02.872614 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 16/31] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 15 07:32:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:32:02.884876 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-257b3c83-8aa4-4347-9ace-437098a3ca56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:32:02.889728 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:02.966935 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-257b3c83-8aa4-4347-9ace-437098a3ca56 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086045 Sep 15 07:32:02.971806 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 16/32] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 15 07:32:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:32:05.648032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-5c5a66c0-69eb-43be-849a-21c0071474e4 admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:05.649104 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-5c5a66c0-69eb-43be-849a-21c0071474e4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 15 07:32:05.649508 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:32:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:32:06.084526 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-d4966ae7-80ef-4bd5-8d4c-0c07512c5775 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "swap": 0, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:32:06.173353 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-d4966ae7-80ef-4bd5-8d4c-0c07512c5775 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.517669 Sep 15 07:32:06.174250 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 17/34] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 15 07:32:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 07:32:06.186775 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-e1d690b7-01e2-4113-8b85-df72e85ccb76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:32:06.261982 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-e1d690b7-01e2-4113-8b85-df72e85ccb76 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078730 Sep 15 07:32:06.262496 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 18/35] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 15 07:32:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:32:23.138681 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-d4966ae7-80ef-4bd5-8d4c-0c07512c5775 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:23.139706 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-d4966ae7-80ef-4bd5-8d4c-0c07512c5775 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 15 07:32:23.140114 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:32:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:32:23.151127 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:23.542533 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-4dd2f9cb-cccd-4ad9-9413-cc6e579b6d4c admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:23.560956 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-4dd2f9cb-cccd-4ad9-9413-cc6e579b6d4c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.414834 Sep 15 07:32:23.561558 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 15 07:32:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:32:24.876087 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-d4966ae7-80ef-4bd5-8d4c-0c07512c5775 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:24.877158 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-d4966ae7-80ef-4bd5-8d4c-0c07512c5775 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 15 07:32:24.877550 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:32:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:32:25.518737 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-ee070e88-f87f-4aa0-91ff-3645bf108cfa admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:25.524033 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.wsgi [None req-ee070e88-f87f-4aa0-91ff-3645bf108cfa admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-ee070e88-f87f-4aa0-91ff-3645bf108cfa admin admin] Request method failure captured: Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Accept: application/json Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Accept-Encoding: gzip, deflate Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Connection: keep-alive Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Content-Length: 0 Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Host: 10.222.0.42 Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Openstack-Api-Version: compute 2.92 Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Openstack-System-Scope: None Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: User-Agent: python-novaclient Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Auth-Token: gAAAAABjItUIMy1OrUcb76sSe7MBBQdp0rcJE_0m8qS1mpr95LWnYV7nVTkwEIt5PhDyHfBHkMLbOv4vknzKzukf2uSeN_hvpfySA5PEaTwsRZ5US9O0tDxYHet60uxAq7TbVSU0btt-MJAtnzd8c1gGkeIBDZEk8-4hOzyKTqeAp1wBZbK3KtI Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Domain-Id: None Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Domain-Name: None Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Identity-Status: Confirmed Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Is-Admin-Project: True Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Domain-Id: default Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Domain-Name: Default Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Name: admin Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Role: member,reader,admin Sep 15 07:32:25.528032 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Roles: member,reader,admin Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_918580af0a81452f8da95d60256aaea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/918580af0a81452f8da95d60256aaea0"}]}] Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Tenant: admin Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Tenant-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Tenant-Name: admin Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User: admin Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Domain-Id: default Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Domain-Name: Default Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Id: 06cea60dcdfb4c5ead6de8db2f0fd82f Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Name: admin Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: method: > Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: exception: Flavor 42 could not be found. Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: action_args: {'id': '42'} Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:32:25.529717 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:25.530774 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:25.532006 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-ee070e88-f87f-4aa0-91ff-3645bf108cfa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:32:25.533099 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-ee070e88-f87f-4aa0-91ff-3645bf108cfa admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.513707 Sep 15 07:32:25.533099 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 15 07:32:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 515 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:25.539362 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-659f6491-6f53-43ad-a227-5f10a4aba2e2 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:25.544149 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:32:25.562402 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-659f6491-6f53-43ad-a227-5f10a4aba2e2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026617 Sep 15 07:32:25.562947 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 20/40] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 15 07:32:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:32:25.573650 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-beb2fab3-7fea-4fd5-bdac-89b780d9942f admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:25.595617 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-beb2fab3-7fea-4fd5-bdac-89b780d9942f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026652 Sep 15 07:32:25.596145 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 15 07:32:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:32:25.606273 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-e059b8a7-664a-43c1-b8c6-7cc0451392e7 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:25.611575 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.wsgi [None req-e059b8a7-664a-43c1-b8c6-7cc0451392e7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-e059b8a7-664a-43c1-b8c6-7cc0451392e7 admin admin] Request method failure captured: Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Accept: application/json Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Accept-Encoding: gzip, deflate Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Connection: keep-alive Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Content-Length: 0 Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Host: 10.222.0.42 Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Openstack-Api-Version: compute 2.92 Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Openstack-System-Scope: None Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: User-Agent: python-novaclient Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Auth-Token: gAAAAABjItUIMy1OrUcb76sSe7MBBQdp0rcJE_0m8qS1mpr95LWnYV7nVTkwEIt5PhDyHfBHkMLbOv4vknzKzukf2uSeN_hvpfySA5PEaTwsRZ5US9O0tDxYHet60uxAq7TbVSU0btt-MJAtnzd8c1gGkeIBDZEk8-4hOzyKTqeAp1wBZbK3KtI Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Domain-Id: None Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Domain-Name: None Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Identity-Status: Confirmed Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Is-Admin-Project: True Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Domain-Id: default Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Domain-Name: Default Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Name: admin Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Role: member,reader,admin Sep 15 07:32:25.615151 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Roles: member,reader,admin Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_918580af0a81452f8da95d60256aaea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/918580af0a81452f8da95d60256aaea0"}]}] Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Tenant: admin Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Tenant-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Tenant-Name: admin Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User: admin Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Domain-Id: default Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Domain-Name: Default Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Id: 06cea60dcdfb4c5ead6de8db2f0fd82f Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Name: admin Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: method: > Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: exception: Flavor 42 could not be found. Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: action_args: {'id': '42'} Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:32:25.616646 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:25.617661 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:25.619896 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-e059b8a7-664a-43c1-b8c6-7cc0451392e7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:32:25.621112 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-e059b8a7-664a-43c1-b8c6-7cc0451392e7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014690 Sep 15 07:32:25.621112 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 15 07:32:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:26.856370 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-beb2fab3-7fea-4fd5-bdac-89b780d9942f admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:26.857400 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-beb2fab3-7fea-4fd5-bdac-89b780d9942f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 15 07:32:26.857926 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:32:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:32:27.404238 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-cb0ed2a1-3fbf-440a-935b-3ea9debee3a1 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:27.409448 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.wsgi [None req-cb0ed2a1-3fbf-440a-935b-3ea9debee3a1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-cb0ed2a1-3fbf-440a-935b-3ea9debee3a1 admin admin] Request method failure captured: Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Accept: application/json Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Accept-Encoding: gzip, deflate Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Connection: keep-alive Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Content-Length: 0 Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Host: 10.222.0.42 Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Openstack-Api-Version: compute 2.92 Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Openstack-System-Scope: None Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: User-Agent: python-novaclient Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Auth-Token: gAAAAABjItUK_KZJAkfG-SdO8KorAH83HAPoKyMIFY3x2Ej6hKRLkDpk37zEdV57r_DaMWutzukwjw50FB6ST7WZKRQnBLTecofwEKOdkQwAwzLGLqwu7lwKYT4Pplt6D8yeB9Pzf1STCLk445VbqAUw5YT-2GqRut2PbkAu__AZRvyREHqB1-s Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Domain-Id: None Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Domain-Name: None Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Identity-Status: Confirmed Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Is-Admin-Project: True Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Domain-Id: default Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Domain-Name: Default Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Name: admin Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Role: member,reader,admin Sep 15 07:32:27.411089 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Roles: member,reader,admin Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_918580af0a81452f8da95d60256aaea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/918580af0a81452f8da95d60256aaea0"}]}] Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Tenant: admin Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Tenant-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Tenant-Name: admin Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User: admin Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Domain-Id: default Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Domain-Name: Default Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Id: 06cea60dcdfb4c5ead6de8db2f0fd82f Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Name: admin Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: method: > Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: exception: Flavor 84 could not be found. Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: action_args: {'id': '84'} Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:32:27.412682 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:27.413872 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:27.415852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-cb0ed2a1-3fbf-440a-935b-3ea9debee3a1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:32:27.417128 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-cb0ed2a1-3fbf-440a-935b-3ea9debee3a1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.412039 Sep 15 07:32:27.417128 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 15 07:32:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:27.424239 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-afb71bd1-dbb7-40c8-a284-487cf669b163 admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:27.440310 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-afb71bd1-dbb7-40c8-a284-487cf669b163 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019633 Sep 15 07:32:27.440862 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 15 07:32:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:32:27.451702 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-d0ab55ba-ce22-49ed-a129-12b4bddeebf9 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:27.468355 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-d0ab55ba-ce22-49ed-a129-12b4bddeebf9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020204 Sep 15 07:32:27.468888 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 15 07:32:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:32:27.478432 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-2bba885a-4dbc-4e2d-b382-20d65072d484 admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:27.483434 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.wsgi [None req-2bba885a-4dbc-4e2d-b382-20d65072d484 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-2bba885a-4dbc-4e2d-b382-20d65072d484 admin admin] Request method failure captured: Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Accept: application/json Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Accept-Encoding: gzip, deflate Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Connection: keep-alive Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Content-Length: 0 Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Host: 10.222.0.42 Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Openstack-Api-Version: compute 2.92 Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Openstack-System-Scope: None Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: User-Agent: python-novaclient Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Auth-Token: gAAAAABjItUK_KZJAkfG-SdO8KorAH83HAPoKyMIFY3x2Ej6hKRLkDpk37zEdV57r_DaMWutzukwjw50FB6ST7WZKRQnBLTecofwEKOdkQwAwzLGLqwu7lwKYT4Pplt6D8yeB9Pzf1STCLk445VbqAUw5YT-2GqRut2PbkAu__AZRvyREHqB1-s Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Domain-Id: None Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Domain-Name: None Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Identity-Status: Confirmed Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Is-Admin-Project: True Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Domain-Id: default Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Domain-Name: Default Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Name: admin Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Role: member,reader,admin Sep 15 07:32:27.484943 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Roles: member,reader,admin Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_918580af0a81452f8da95d60256aaea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/918580af0a81452f8da95d60256aaea0"}]}] Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Tenant: admin Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Tenant-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Tenant-Name: admin Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User: admin Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Domain-Id: default Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Domain-Name: Default Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Id: 06cea60dcdfb4c5ead6de8db2f0fd82f Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Name: admin Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: method: > Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: exception: Flavor 84 could not be found. Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: action_args: {'id': '84'} Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:32:27.486470 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:27.487430 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:27.488827 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-2bba885a-4dbc-4e2d-b382-20d65072d484 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:32:27.490323 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-2bba885a-4dbc-4e2d-b382-20d65072d484 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011576 Sep 15 07:32:27.490323 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 15 07:32:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:28.730628 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-d0ab55ba-ce22-49ed-a129-12b4bddeebf9 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:28.731639 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-d0ab55ba-ce22-49ed-a129-12b4bddeebf9 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 15 07:32:28.732040 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:32:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:32:29.256401 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-3b28d342-071b-4738-a7ff-7ae60b3fdd1b admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:29.262247 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.wsgi [None req-3b28d342-071b-4738-a7ff-7ae60b3fdd1b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-3b28d342-071b-4738-a7ff-7ae60b3fdd1b admin admin] Request method failure captured: Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Accept: application/json Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Accept-Encoding: gzip, deflate Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Connection: keep-alive Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Content-Length: 0 Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Host: 10.222.0.42 Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Openstack-Api-Version: compute 2.92 Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Openstack-System-Scope: None Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: User-Agent: python-novaclient Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Auth-Token: gAAAAABjItUMXK2pGAiHOt71p1Mrj3C6SIqZ4kEmv7Ik8JQAPKzFMWAD1TBznKLhkooTvYCOxaB9ygEbIstz49rZ74jx1elHgP_yoqjvYgtmlX3RZ0B5pCBjAQY0ncNwE4x5jSiubDHLe0wUrjDvJiWS1Bs7HS_MdwIdLsQSsFGLG9uhTm0kMPg Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Domain-Id: None Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Domain-Name: None Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Identity-Status: Confirmed Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Is-Admin-Project: True Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Domain-Id: default Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Domain-Name: Default Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Project-Name: admin Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Role: member,reader,admin Sep 15 07:32:29.263731 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Roles: member,reader,admin Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_918580af0a81452f8da95d60256aaea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/918580af0a81452f8da95d60256aaea0"}]}] Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Tenant: admin Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Tenant-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-Tenant-Name: admin Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User: admin Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Domain-Id: default Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Domain-Name: Default Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Id: 06cea60dcdfb4c5ead6de8db2f0fd82f Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: X-User-Name: admin Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: method: > Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: exception: Flavor 451 could not be found. Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: action_args: {'id': '451'} Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:32:29.265227 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:29.266193 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: ERROR nova.api.openstack.wsgi Sep 15 07:32:29.267433 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-3b28d342-071b-4738-a7ff-7ae60b3fdd1b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:32:29.268726 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-3b28d342-071b-4738-a7ff-7ae60b3fdd1b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390569 Sep 15 07:32:29.268726 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 15 07:32:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:29.275388 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-2bc8c1a7-b03a-4ea4-a6e7-6faaf244f884 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:29.291036 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-2bc8c1a7-b03a-4ea4-a6e7-6faaf244f884 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019092 Sep 15 07:32:29.291719 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 15 07:32:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:32:29.301058 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:29.316150 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018616 Sep 15 07:32:29.316675 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 15 07:32:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:32:29.326162 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-70589955-929a-4fb6-9580-7a9205fde0a9 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:29.331166 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.wsgi [None req-70589955-929a-4fb6-9580-7a9205fde0a9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-70589955-929a-4fb6-9580-7a9205fde0a9 admin admin] Request method failure captured: Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Accept: application/json Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Accept-Encoding: gzip, deflate Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Connection: keep-alive Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Content-Length: 0 Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Host: 10.222.0.42 Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Openstack-Api-Version: compute 2.92 Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Openstack-System-Scope: None Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: User-Agent: python-novaclient Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Auth-Token: gAAAAABjItUMXK2pGAiHOt71p1Mrj3C6SIqZ4kEmv7Ik8JQAPKzFMWAD1TBznKLhkooTvYCOxaB9ygEbIstz49rZ74jx1elHgP_yoqjvYgtmlX3RZ0B5pCBjAQY0ncNwE4x5jSiubDHLe0wUrjDvJiWS1Bs7HS_MdwIdLsQSsFGLG9uhTm0kMPg Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Domain-Id: None Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Domain-Name: None Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Identity-Status: Confirmed Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Is-Admin-Project: True Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Openstack-Nova-Api-Version: 2.92 Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Domain-Id: default Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Domain-Name: Default Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Project-Name: admin Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Role: member,reader,admin Sep 15 07:32:29.332817 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Roles: member,reader,admin Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_918580af0a81452f8da95d60256aaea0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/918580af0a81452f8da95d60256aaea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/918580af0a81452f8da95d60256aaea0"}]}] Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Tenant: admin Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Tenant-Id: 918580af0a81452f8da95d60256aaea0 Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-Tenant-Name: admin Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User: admin Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Domain-Id: default Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Domain-Name: Default Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Id: 06cea60dcdfb4c5ead6de8db2f0fd82f Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: X-User-Name: admin Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: method: > Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: exception: Flavor 451 could not be found. Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: action_args: {'id': '451'} Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:32:29.334391 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:29.335326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: ERROR nova.api.openstack.wsgi Sep 15 07:32:29.336617 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-70589955-929a-4fb6-9580-7a9205fde0a9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106039) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:32:29.338538 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-70589955-929a-4fb6-9580-7a9205fde0a9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011573 Sep 15 07:32:29.338538 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 26/52] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 15 07:32:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 07:32:30.567549 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:30.568553 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 15 07:32:30.568951 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:32:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:32:31.094830 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-2e0f267f-0b30-4aec-8278-054e3fc23952 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:32:31.205283 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-2e0f267f-0b30-4aec-8278-054e3fc23952 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.497347 Sep 15 07:32:31.205839 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 27/54] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 15 07:32:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:32:32.426614 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:32.427615 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 15 07:32:32.428005 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:32:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:32:32.955647 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-c2d1afbe-4263-4715-b517-2f2facf83a3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:32:33.028609 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-c2d1afbe-4263-4715-b517-2f2facf83a3c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.454706 Sep 15 07:32:33.029157 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 28/56] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 15 07:32:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:32:34.244963 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:34.246013 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Sep 15 07:32:34.246449 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:32:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:32:34.777145 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-4efd28a5-5bdb-407f-9365-4f4d671bfc9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:32:34.851863 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-4efd28a5-5bdb-407f-9365-4f4d671bfc9f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.463198 Sep 15 07:32:34.852410 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 29/58] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 15 07:32:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 07:32:36.079616 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:36.080636 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 15 07:32:36.081045 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:32:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:32:36.603291 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-980e0b15-6a16-40c6-8d58-8e1a4b78f8e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:32:36.672265 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-980e0b15-6a16-40c6-8d58-8e1a4b78f8e8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.452577 Sep 15 07:32:36.672885 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 30/60] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 15 07:32:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 07:32:37.912190 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:37.913187 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 15 07:32:37.913593 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:32:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:32:38.457413 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-001cbfeb-ba1b-4fe4-a489-562b3fed5781 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:32:38.478112 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-001cbfeb-ba1b-4fe4-a489-562b3fed5781 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.427011 Sep 15 07:32:38.478919 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1202 bytes} [Thu Sep 15 07:32:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:33:36.004038 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:33:36.005076 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-314f6e91-0ff0-4485-a461-080bb8db6cde admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 15 07:33:36.005474 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 15 07:33:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:33:36.016925 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:33:36.407326 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-6a22869f-aad5-43a2-a5ee-64f19932bfc8 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:33:36.427999 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-6a22869f-aad5-43a2-a5ee-64f19932bfc8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.416357 Sep 15 07:33:36.428537 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 32/64] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 15 07:33:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:33:36.453510 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-30085d5f-f1e1-48d1-8471-535a5372acc1 admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:33:36.457018 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writing DB stats nova_api:SELECT=14 {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:33:36.461671 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-30085d5f-f1e1-48d1-8471-535a5372acc1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012571 Sep 15 07:33:36.462190 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1283 bytes} [Thu Sep 15 07:33:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:33:36.474095 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-6dd8a868-3f6a-46b8-bcbf-24ec41beb934 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:33:36.482064 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-6dd8a868-3f6a-46b8-bcbf-24ec41beb934 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011517 Sep 15 07:33:36.482588 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 33/66] 10.222.0.42 () {60 vars in 1286 bytes} [Thu Sep 15 07:33:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:33:36.498142 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-b5b369e6-2a64-4782-a51b-137980d7265c admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:33:36.505647 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-b5b369e6-2a64-4782-a51b-137980d7265c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012373 Sep 15 07:33:36.506206 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 34/67] 10.222.0.42 () {60 vars in 1286 bytes} [Thu Sep 15 07:33:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:33:36.517907 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-14871116-2e23-4876-9873-05f094ad76ff admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:33:36.525001 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-14871116-2e23-4876-9873-05f094ad76ff admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010805 Sep 15 07:33:36.525517 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1283 bytes} [Thu Sep 15 07:33:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:36:36.985988 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-b5b369e6-2a64-4782-a51b-137980d7265c admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:36:36.986997 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-b5b369e6-2a64-4782-a51b-137980d7265c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 15 07:36:36.987392 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:36:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:36:37.130656 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writing DB stats nova_api:SELECT=6 {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:37.290381 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-cea3beaf-53fb-4133-841a-73a144909979 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:36:37.295708 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-cea3beaf-53fb-4133-841a-73a144909979 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:36:37.296175 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-cea3beaf-53fb-4133-841a-73a144909979 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:36:37.296592 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-cea3beaf-53fb-4133-841a-73a144909979 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:36:37.297291 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-cea3beaf-53fb-4133-841a-73a144909979 admin admin] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:36:37.297764 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-cea3beaf-53fb-4133-841a-73a144909979 admin admin] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:36:37.298173 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-cea3beaf-53fb-4133-841a-73a144909979 admin admin] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:36:37.330171 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-cea3beaf-53fb-4133-841a-73a144909979 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.200788 Sep 15 07:36:37.332001 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 35/70] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 15 07:36:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:36:38.465469 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-b5b369e6-2a64-4782-a51b-137980d7265c admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:36:38.466620 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-b5b369e6-2a64-4782-a51b-137980d7265c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Sep 15 07:36:38.467010 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:36:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:36:38.667428 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-3b6030c5-85c4-4c91-9b63-734a34d44f0c admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:36:38.670852 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-3b6030c5-85c4-4c91-9b63-734a34d44f0c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:36:38.671272 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-3b6030c5-85c4-4c91-9b63-734a34d44f0c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:36:38.671721 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-3b6030c5-85c4-4c91-9b63-734a34d44f0c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:36:38.672455 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-3b6030c5-85c4-4c91-9b63-734a34d44f0c admin admin] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:36:38.672895 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-3b6030c5-85c4-4c91-9b63-734a34d44f0c admin admin] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:36:38.673304 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-3b6030c5-85c4-4c91-9b63-734a34d44f0c admin admin] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:36:38.693013 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-3b6030c5-85c4-4c91-9b63-734a34d44f0c admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077328 Sep 15 07:36:38.693557 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 36/72] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 15 07:36:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:36:50.184100 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-b5b369e6-2a64-4782-a51b-137980d7265c admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:36:50.185098 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-b5b369e6-2a64-4782-a51b-137980d7265c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Sep 15 07:36:50.186235 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:36:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:36:50.337099 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writing DB stats nova_cell0:SELECT=4 {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:50.337839 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writing DB stats nova_cell1:SELECT=4 {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:50.338483 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG dbcounter [-] [106039] Writing DB stats nova_api:SELECT=8 {{(pid=106039) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:36:50.394300 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-06fa1003-8ae4-414c-9544-68e24fc035f6 admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:36:50.394300 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-06fa1003-8ae4-414c-9544-68e24fc035f6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:36:50.394300 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-06fa1003-8ae4-414c-9544-68e24fc035f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:36:50.394300 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-06fa1003-8ae4-414c-9544-68e24fc035f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:36:50.394300 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-06fa1003-8ae4-414c-9544-68e24fc035f6 admin admin] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:36:50.394866 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-06fa1003-8ae4-414c-9544-68e24fc035f6 admin admin] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:36:50.394866 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-06fa1003-8ae4-414c-9544-68e24fc035f6 admin admin] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:36:50.419853 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-06fa1003-8ae4-414c-9544-68e24fc035f6 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.087354 Sep 15 07:36:50.420500 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 37/74] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 15 07:36:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:36:51.519604 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG nova.api.openstack.wsgi [None req-b5b369e6-2a64-4782-a51b-137980d7265c admin admin] Calling method '>' {{(pid=106040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:36:51.520610 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: INFO nova.api.openstack.requestlog [None req-b5b369e6-2a64-4782-a51b-137980d7265c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Sep 15 07:36:51.521011 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: [pid: 106040|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 15 07:36:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:36:51.726094 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG nova.api.openstack.wsgi [None req-e03fc999-8eb2-45b2-bd2e-84f2aa0c50be admin admin] Calling method '>' {{(pid=106039) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:36:51.729522 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-e03fc999-8eb2-45b2-bd2e-84f2aa0c50be admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:36:51.730019 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-e03fc999-8eb2-45b2-bd2e-84f2aa0c50be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:36:51.730497 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-e03fc999-8eb2-45b2-bd2e-84f2aa0c50be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:36:51.731202 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-e03fc999-8eb2-45b2-bd2e-84f2aa0c50be admin admin] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:36:51.731647 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-e03fc999-8eb2-45b2-bd2e-84f2aa0c50be admin admin] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:36:51.732061 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: DEBUG oslo_concurrency.lockutils [None req-e03fc999-8eb2-45b2-bd2e-84f2aa0c50be admin admin] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:36:51.754226 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: INFO nova.api.openstack.requestlog [None req-e03fc999-8eb2-45b2-bd2e-84f2aa0c50be admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.083415 Sep 15 07:36:51.754773 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: [pid: 106039|app: 0|req: 38/76] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 15 07:36:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:37:47.571105 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: Thu Sep 15 07:37:47 2022 - graceful shutdown triggered... Sep 15 07:37:47.571241 dv-cinder-824149-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 15 07:37:47.572956 dv-cinder-824149-6-iscsi devstack@n-api.service[106039]: Gracefully killing worker 1 (pid: 106039)... Sep 15 07:37:47.573363 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: Gracefully killing worker 2 (pid: 106040)... Sep 15 07:37:47.703423 dv-cinder-824149-6-iscsi devstack@n-api.service[106040]: DEBUG dbcounter [-] [106040] Writing DB stats nova_api:SELECT=4 {{(pid=106040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:37:48.573455 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: worker 1 buried after 1 seconds Sep 15 07:37:48.573455 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: worker 2 buried after 1 seconds Sep 15 07:37:48.574127 dv-cinder-824149-6-iscsi devstack@n-api.service[106038]: goodbye to uWSGI. Sep 15 07:37:48.574984 dv-cinder-824149-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 15 07:37:48.575523 dv-cinder-824149-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 15 07:37:48.578278 dv-cinder-824149-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 07:37:48.588191 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 07:37:48 2022] *** Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: nodename: dv-cinder-824149-6-iscsi Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: machine: x86_64 Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: clock source: unix Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: pcre jit disabled Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: detected number of CPU cores: 4 Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: current working directory: / Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: detected binary path: /usr/bin/uwsgi-core Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: your processes number limit is 47680 Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: your memory page size is 4096 bytes Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: detected max file descriptor number: 2048 Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: lock engine: pthread robust mutexes Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: thunder lock: enabled Sep 15 07:37:48.590663 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 07:37:48.591672 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 07:37:48.630938 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: Python main interpreter initialized at 0x55c40bb549c0 Sep 15 07:37:48.630938 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: python threads support enabled Sep 15 07:37:48.630938 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: your server socket listen backlog is limited to 100 connections Sep 15 07:37:48.630938 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: your mercy for graceful operations on workers is 90 seconds Sep 15 07:37:48.631335 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 07:37:48.631403 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: *** Operational MODE: preforking *** Sep 15 07:37:48.631676 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: *** uWSGI is running in multiple interpreter mode *** Sep 15 07:37:48.631676 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: spawned uWSGI master process (pid: 132659) Sep 15 07:37:48.631879 dv-cinder-824149-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 07:37:48.634413 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: spawned uWSGI worker 1 (pid: 132673, cores: 1) Sep 15 07:37:48.634413 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: spawned uWSGI worker 2 (pid: 132674, cores: 1) Sep 15 07:37:48.634413 dv-cinder-824149-6-iscsi devstack@n-api.service[132659]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 07:37:49.301532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 07:37:49.322220 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 15 07:37:50.468229 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:37:50.468229 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: from cryptography.utils import int_from_bytes Sep 15 07:37:50.468866 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:37:50.468866 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: from cryptography.utils import int_from_bytes Sep 15 07:37:50.500063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:37:50.500063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: from cryptography.utils import int_from_bytes Sep 15 07:37:50.500757 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 07:37:50.500757 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: from cryptography.utils import int_from_bytes Sep 15 07:37:52.930511 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 07:37:52.931101 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 07:37:52.931387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 07:37:52.931697 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 07:37:52.931956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 07:37:52.932353 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.932687 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.933017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.933340 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.933704 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.934022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.934348 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.934673 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.935004 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.935264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.935582 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.936082 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824149-6-iscsi {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.936410 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.936730 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.937047 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.937374 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.937714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.938045 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.938355 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.938895 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.941292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.941292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.941292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.941292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.941292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.941926 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.941926 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.942232 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.942570 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.942897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.943316 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824149-6-iscsi {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.943639 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.943963 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.944277 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.944713 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.945031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.945357 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.945709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.946053 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.946347 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.946719 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.947253 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.947836 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.948407 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.948876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.949203 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.949525 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.949900 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.950205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.950517 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.950775 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.951103 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.951417 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.951744 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.952076 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.952333 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.952603 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.952924 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.953243 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.953554 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.960056 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.960416 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.960761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.961101 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.961436 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.961797 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.962130 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.962869 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.962869 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.963131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.963768 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.964105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.964531 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.964796 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.965118 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.965476 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.965829 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.966157 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.966487 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.966818 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.967135 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.967450 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.967773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.968103 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.968452 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.968768 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.969027 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.969705 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.970036 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.970486 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.970791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.971108 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.971427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.971724 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.972040 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.972350 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.972663 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.972975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.973285 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.973625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.973950 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.974263 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.974579 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.974889 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.975222 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.975550 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.975865 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.976178 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.976490 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.976802 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.977128 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.977440 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.977807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.978133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.978450 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.978762 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.979087 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.979399 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.979711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.980035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.980342 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.980654 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.980976 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.981286 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.981628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.981931 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.982241 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.982549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.982858 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.983166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.983477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.983781 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.984114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.984434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.984749 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.985128 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.986445 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.986445 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.986859 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.987002 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.987245 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.987562 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.987900 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.988241 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.988564 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.988880 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.989197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.989528 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.989870 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.990182 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.990496 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.990816 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.991137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.991470 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.991792 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.992112 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.992434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.992750 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.993073 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.993402 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.993752 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.994068 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.994417 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.994766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.995082 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.995411 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.995637 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 07:37:52.996302 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.996520 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 07:37:52.996731 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.996947 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 07:37:52.997169 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.997169 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.997568 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 07:37:52.997568 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 07:37:52.998115 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.998115 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.998536 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.998755 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.998969 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.999183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.999397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:52.999611 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:52.999834 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.000038 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.000252 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.000471 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.000675 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.000895 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.001089 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.001246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.002129 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.002301 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.002455 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.002670 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.002884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.003102 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.003321 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.003537 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.003720 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824149-6-iscsi {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.003876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.004050 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.004194 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.004388 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.004625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.004855 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.005072 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.005284 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.005466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.005650 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.005824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.005981 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.006177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.006381 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.006596 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.006596 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.007053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.007250 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.007408 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.007585 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.007737 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.007929 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.008145 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.008365 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.008591 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.008823 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.009029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.009227 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.009390 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.009543 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.009723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.009875 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.010027 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.010177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.010329 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.010482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.010632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.010790 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.010790 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.011095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824149-6-iscsi {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.011258 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.011409 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.011553 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.011695 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.012467 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.012559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.012651 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.012751 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.012827 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.013078 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.013181 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.013257 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.013327 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.013396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.013472 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.013550 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.013672 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.013755 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.013828 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.013904 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.013982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.014067 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.014150 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.014150 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.014291 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.014383 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.014620 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.014726 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.014838 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.014930 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.015012 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.015129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.015246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.015336 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.015420 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.015527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.015600 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.015688 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.015801 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.015801 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.015961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.016050 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.016133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.016220 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.016616 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.016717 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.016810 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.016810 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.017017 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.017104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.017335 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.017335 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.017508 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.017620 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.017720 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.017720 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.017890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.017979 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.018061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.018142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.018232 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.018327 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.018417 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.018506 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.018588 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.018676 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.018766 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.018857 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.018954 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.019048 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.019419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.019538 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.019624 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.019706 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.019832 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.020028 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.020190 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.020346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.020499 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.020651 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.020804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.020958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.021109 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.021253 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.021473 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.021661 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.021829 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.021975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.022127 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.022280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.022431 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.022584 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.022728 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.022870 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.023014 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.023166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.023323 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.023485 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.023629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.023770 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.023922 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.024073 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.024223 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.024375 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.024525 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.024677 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.024830 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.024984 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.025163 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.025322 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.025474 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.025665 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.025817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.026007 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.026164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.026315 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.026467 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.026618 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.026769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.026919 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.027070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.027222 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.027373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.027523 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.027673 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.027824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.027985 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.028129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.028272 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.028415 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.028557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.028706 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.028863 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.029007 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.029156 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.029307 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.029449 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.029627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.029797 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.029951 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.030094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.030245 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.030396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.030553 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.030696 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.030846 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.031225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.031390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.031558 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.031733 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.031894 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.032039 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.032198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.032355 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.032505 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.032767 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.032925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.033069 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.033222 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.033375 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.033375 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.033739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.033896 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.034077 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.034250 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.034396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.034396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.034677 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.034828 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.034982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.035125 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.035275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.035275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.035555 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.035707 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.035864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.036008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.036161 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.036304 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.036447 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.036590 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.036742 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.036893 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.037043 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.037197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.037342 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.037493 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.037675 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.037826 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.037979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.038136 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.038287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.038437 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.038594 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.038738 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.038881 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.039032 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.039182 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.039339 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.039483 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.039626 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.039777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.039777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.040066 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.040066 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.040390 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.040536 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.040679 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.040830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.040980 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.041136 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.041288 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.041442 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.041640 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.041793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.041936 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 07:37:53.042102 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.042246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.042389 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.042532 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.042675 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.042830 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.042975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.043117 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.043266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.043427 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.043572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.043728 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.043884 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.044027 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.044210 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.044360 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.044503 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.044655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.044799 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.045018 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.045165 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.045308 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.045460 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.045631 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.045799 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.045956 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.046153 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.046310 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.046535 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.046687 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.046831 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.047147 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.047310 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.047464 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.047618 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.047762 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.047905 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.048067 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.048777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.048777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.049121 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.049275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.049424 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.049601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.049760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.049927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.050078 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.050078 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.050370 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.050521 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.050690 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.050855 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.051006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.051155 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.051304 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.051453 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.051602 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.051771 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.051935 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.052085 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.052242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.052394 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.052543 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.052709 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.052859 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.052859 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.053151 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.053301 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.053459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.053637 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.053812 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.053974 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.054138 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.054297 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.054455 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.054636 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.054810 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.054968 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.055127 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.055314 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.055477 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.055636 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.055793 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.055942 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.056103 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.056253 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.056402 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.056551 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.056722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.056882 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.057046 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.057196 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.057344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.057492 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.057666 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.057831 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.057989 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.058139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.058287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.058443 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.058443 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.058747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.058897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.059045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.059201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.059352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.059509 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.059673 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.059841 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.060000 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.060150 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.060306 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.060470 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.060629 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.060629 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.060929 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.061087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.061237 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.061237 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.061535 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.061707 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.061859 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.062008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.062170 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.062330 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.062479 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.062636 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.062797 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.062946 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.063095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.063259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.063416 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.063573 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.063731 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.064444 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.064617 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.064776 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.064935 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.065085 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.065251 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.065401 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.065563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.065563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.065914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.066071 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.066228 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.066377 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.066536 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.066693 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.066851 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.067009 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.067167 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.067326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.067486 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.067636 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.067785 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.067785 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.068084 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.068247 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.068405 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.068563 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.068713 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.068862 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.069011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.069171 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.069344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.069502 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.069683 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.069845 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.070059 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.070226 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.070385 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.070543 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.070693 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.070850 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.071000 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.071163 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.071313 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.071472 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.071621 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.071770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.071928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.072080 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.072229 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.072385 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.072542 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.072699 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.072862 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.073021 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.073189 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.073351 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.073509 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.073693 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.073865 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.074017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.074173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.074324 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.074480 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.074647 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.074853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.075017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.075168 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.075318 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.075486 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.075646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.075797 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.075955 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.076119 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.076278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.076437 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.076596 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.076746 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.076896 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.077044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.077193 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.077193 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.077497 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.077713 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.077867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.078015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.078163 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.078325 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.078489 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.078647 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.078804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.078954 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.079103 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.079265 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.079433 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.079605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.079763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.079914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.080070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.080224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.080344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.080439 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.080536 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.080624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.080709 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.080804 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.080897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.080981 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.081071 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.081162 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.081315 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.081408 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.081493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.081608 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.081722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.081808 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.081900 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.081984 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.082076 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.082160 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.082241 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.082385 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.082559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.082713 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.082869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.083020 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.083184 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.083334 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.083497 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.083655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.083813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.083972 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.084121 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.084281 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.084444 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.084595 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.084744 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.084905 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.085066 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.085226 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.085376 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.085524 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.085730 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.085897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.086050 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.086209 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.086368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.086519 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.086676 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.086835 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.086986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.087149 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.087307 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.087465 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.087615 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.087774 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.087925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.088157 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.088310 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.088480 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.088632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.088789 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.088953 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.089113 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.089270 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.089421 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.089615 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.089788 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.089953 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.090104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.090261 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.090420 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.090580 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.090737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.090737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.091041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.091200 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.091357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.091507 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.091657 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.091816 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.091967 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.092126 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.092275 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.092275 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.092582 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.092740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.092898 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.093055 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.093213 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.093371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.093530 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.093692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.093785 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.093882 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.093975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.094060 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.094156 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.094241 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.094323 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.094559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.094660 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.094880 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.094982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.095339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.095478 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.095679 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.095770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.095997 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.096097 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.096311 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.096493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.096654 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.096806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.096965 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.097115 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.097264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.097430 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.097643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.097804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.097968 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.098120 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.098278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.098448 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.098608 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.098765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.098930 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.099089 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.099272 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.099429 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.099581 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.099743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.099901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.100050 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.100207 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.100368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.100526 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.100689 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.100840 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.100989 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.101138 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.101294 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.101444 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.101621 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.101789 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.101941 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.102099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.102256 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.102415 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.102580 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.102732 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.102882 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.103038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.103188 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.103347 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.103498 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.103649 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.103807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.103964 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.104114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.104437 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.104596 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.104755 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.104913 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.105070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.105231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.105401 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.105559 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.105777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.105938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.106096 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.106256 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.106432 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.106587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.106737 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.106889 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.107049 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.107207 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.107367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.107526 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.107688 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.107839 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.107997 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.108147 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.108303 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.108464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.108623 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.108775 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.108933 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.109084 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.109241 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.109402 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.109553 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.109725 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.109887 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.110046 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.110196 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.110356 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.110523 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.111200 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.111363 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.111593 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.111753 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.111918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.112076 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.112227 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.112384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.112542 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.112700 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.112865 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.113023 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.113192 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.113350 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.113508 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.113702 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.113863 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.114014 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.114172 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.114330 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.114481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.114643 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.114801 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.114959 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.115116 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.115285 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.115451 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.115615 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.115767 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.115917 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.116074 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.116231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.116391 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.116618 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.116770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.116926 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.117081 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.117270 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.117437 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.117608 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.117777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.117927 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.118077 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.118235 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.118396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.118553 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.118704 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.118854 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.119011 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.119168 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.119341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.119494 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.119645 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.119801 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.119960 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.120110 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.120273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.120425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.120583 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.120740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.120890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.121053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.121203 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.121370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.121521 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.121521 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.121862 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.122026 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.122177 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.122327 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.122476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.122628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.122777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.122939 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.123098 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.123266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.123417 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.123574 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.123726 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.123886 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.124036 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.124186 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.124335 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.124491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.124655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.124813 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.124969 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.125120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.125286 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.125445 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.125632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.125793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.125944 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.126094 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.126250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.127050 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.127305 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.127472 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.127632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.127791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.127950 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.128121 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.128288 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.128447 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.128598 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.128755 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.128907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.129072 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.129234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.129392 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.129542 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.129721 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.129825 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.129935 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.130026 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.130121 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.130214 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.130307 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.130418 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.130418 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.130619 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.130716 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.130810 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.130903 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.130995 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.131086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.131170 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.131329 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.131497 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.131663 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.131822 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.131994 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.132146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.132303 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.132461 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.132628 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.132786 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.132944 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.133097 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.133257 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.133417 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.133569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.133769 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.133929 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.134090 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.134240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.134400 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.134551 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.134701 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.134859 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.135009 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.135176 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.135340 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.135498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.135656 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.135814 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.135964 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.136122 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.136282 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.136436 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.136586 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.136735 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.136885 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.137058 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.137210 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.137360 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.137517 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.137723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.137886 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.138117 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.138279 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.138430 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.138586 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.138736 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.138899 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.139057 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.139219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.139377 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.139527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.139684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.139843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.139993 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.140143 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.140300 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.140483 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.140647 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.140810 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.140962 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.141111 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.141270 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.141710 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.141864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.142113 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.142352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.142519 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.142670 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.142829 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.142993 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.143152 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.143311 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.143461 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.143636 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.143788 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.143946 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.144105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.144255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.144404 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.144556 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.144714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.144878 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.145030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.145180 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.145329 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.145478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.145671 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.145844 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.145997 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.146146 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.146295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.146451 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.146610 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.146769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.146927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.147077 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.147233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.147389 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.147553 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.147726 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.147878 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.148028 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.148177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.148327 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.148490 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.148647 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.148647 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.148953 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.149112 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.149263 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.149425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.149632 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.149793 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.149944 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.150093 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.150264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.150422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.150572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.150729 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.150889 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.151038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.151196 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.151346 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.151496 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.151655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.151805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.151963 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.152124 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.152281 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.152431 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.152580 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.152736 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.152736 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.153031 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.153189 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.153347 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.153498 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.153682 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.153853 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.154015 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.154174 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.154325 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.154474 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.154624 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.154784 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.154934 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.155085 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.155241 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.155399 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.155549 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.155730 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.155883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.156034 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.156191 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.156342 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.156499 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.156662 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.156819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.156978 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.157136 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.157293 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.157293 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.157693 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.157867 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.158026 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.158026 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.158493 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.158493 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.158797 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.158948 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.159104 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.159256 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.159419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.159580 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.159732 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.159893 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.160042 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.160192 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.160350 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.160514 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.160672 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.160831 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.160988 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.161140 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.161302 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.161454 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.161717 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.161865 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.161971 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.162062 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.162162 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.162248 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.162332 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.162415 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.162498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.162581 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.162673 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.162766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.162851 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.163020 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.163192 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.163343 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.163596 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.163778 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.163939 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.164091 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.164248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.164408 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.164568 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.164720 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.164879 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.165039 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.165190 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.165364 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.165524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.165707 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.165871 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.166030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.166182 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.166346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.166505 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.166670 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.166829 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.166989 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.167225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.167384 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.167554 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.167714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.167872 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.168031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.168197 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.168356 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.168520 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.168680 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.168839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.168998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.169162 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.169314 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.169482 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.169695 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.169854 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.170005 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.170164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.170330 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.170488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.170639 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.170798 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.171030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.171190 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.171349 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.171502 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.171664 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.171822 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.171986 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.172144 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.172303 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.172454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.172605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.172761 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.172926 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.173083 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.173758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.173758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.174218 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.174218 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.174530 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.174691 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.174842 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.174993 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.175143 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.175301 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.175452 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.175602 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.175752 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.175900 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.176064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.176233 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.176385 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.176541 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.176692 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.176842 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.176991 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.177154 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.177313 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.177463 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.177651 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.177817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.177983 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.178153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.178305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.178455 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.178605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.178768 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.178938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.179094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.179253 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.179414 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.179573 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.179737 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.179897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.180048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.180218 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.180376 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.180580 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.180754 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.180906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.181064 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.181227 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.181387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.181546 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.181748 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.181910 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.182061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.182211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.182373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.182524 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.182682 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.182838 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.182988 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.183139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.183296 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.183449 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.183608 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.183759 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.183909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.184059 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.184059 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.184367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.184528 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.184685 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.184845 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.185009 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.185169 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.185328 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.185481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.185681 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.185846 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.186008 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.186160 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.186329 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.186480 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.186631 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.186788 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.186945 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.187104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.187263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.187414 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.187573 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.187723 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.187881 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.188041 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.188200 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.188368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.188368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.188669 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.188868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.189044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.189198 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.189379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.189661 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.189834 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.189987 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.190148 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.190300 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.190458 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.190627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.190627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.190924 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.191083 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.191242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.191402 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.191554 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.191711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.191876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.192029 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.192179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.192340 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.192502 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.192660 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.192821 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.192973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.193122 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.193272 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.193429 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.193635 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.193806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.193961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.194119 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.194278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.194441 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.194601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.194753 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.194912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.195068 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.195223 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.195373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.195537 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.195688 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.195840 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.195991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.196141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.196141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.196454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.196606 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.196764 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.196916 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.197074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.197310 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.197481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.197657 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.197827 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.197980 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.198138 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.198305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.198468 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.198627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.198785 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.198944 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.199114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.199267 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.199417 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.199574 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.199724 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.199882 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.200051 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.200203 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.200376 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.200535 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.200686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.200836 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.200999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.201152 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.201304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.201461 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.201654 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.201826 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.201992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.202145 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.202145 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.202452 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.202603 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.202767 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.202927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.203085 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.203236 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 07:37:53.203387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.203387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.203387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.203387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.203387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.204116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.204116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.204116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.205125 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.205291 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.205551 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.205898 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.206224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.206769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.207127 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.207454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.207791 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.208128 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.208455 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.208773 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.209105 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.209420 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.209781 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.210095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.210424 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.210740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.211056 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.211378 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.211699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.212015 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.212335 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.212649 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.212987 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.213304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.213640 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.213958 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.214283 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.214595 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.214908 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.215222 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.215535 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.215856 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.216168 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.216570 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.216887 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.217209 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.217567 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.217909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.218225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.218557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.218874 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.219189 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.219519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.219837 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.220228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.220559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.220965 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.221331 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.221684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.222234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.222580 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.222911 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.223257 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.223602 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.223922 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.224240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.224556 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.224890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.225212 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.225537 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.225954 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.226278 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.226600 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.226921 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.227243 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.227564 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.227885 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.228206 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.228526 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.228844 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.229164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.229483 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.229832 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.230185 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.230521 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.230851 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.231180 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.231505 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.231826 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.232144 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.232467 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.232788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.233115 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.233457 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.233807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.234123 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.234549 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.234873 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.235201 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.235533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.236387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.236805 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.237140 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.237463 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.237821 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.238144 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.238484 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.238831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.239167 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.239502 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.239817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.240131 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.240443 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.240762 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.241094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.241413 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.241756 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.242074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.242391 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.242703 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.243017 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.243329 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.243640 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.243956 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.244274 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.244587 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.244897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.245210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.245522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.245858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.246174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.246487 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.246800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.247110 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.247423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.247734 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.248072 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.248415 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.248741 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.249071 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.249390 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.249745 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.250067 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.250397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.250728 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.251061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.252056 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.252421 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.252747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.253072 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.253401 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.253746 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.254070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.254393 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.254785 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.255074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.255379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.255716 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.256044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.256374 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.256701 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.257022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.257360 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.257709 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.258030 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.258349 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.258669 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.258988 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.259311 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.259629 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.259948 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.260275 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.260599 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.260942 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.261279 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.261617 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.261958 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.262294 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.262650 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.262973 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.263324 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.263660 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.263839 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO dbcounter [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Registered counter for database nova_api Sep 15 07:37:53.264001 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.264290 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.264606 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 07:37:53.264861 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 07:37:53.287087 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_db.sqlalchemy.engines [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:37:53.294061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writer thread running {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:37:53.333907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO dbcounter [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Registered counter for database nova_api Sep 15 07:37:53.354854 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_db.sqlalchemy.engines [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:37:53.355563 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.context [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72faee06-56dc-4608-aa3b-e80f5a9bf08f(cell1) {{(pid=132674) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 07:37:53.359588 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:37:53.360067 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:37:53.362293 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:37:53.362455 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writer thread running {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:37:53.363023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:37:53.363467 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:37:53.365483 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:37:53.367526 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO dbcounter [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Registered counter for database nova_cell0 Sep 15 07:37:53.371573 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO dbcounter [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Registered counter for database nova_cell1 Sep 15 07:37:53.382657 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_db.sqlalchemy.engines [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:37:53.383463 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_db.sqlalchemy.engines [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:37:53.387871 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writer thread running {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:37:53.419898 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.context [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72faee06-56dc-4608-aa3b-e80f5a9bf08f(cell1) {{(pid=132673) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 07:37:53.424569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:37:53.425039 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:37:53.426671 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:37:53.427414 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:37:53.427875 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:37:53.429936 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:37:53.432006 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO dbcounter [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Registered counter for database nova_cell0 Sep 15 07:37:53.436058 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO dbcounter [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Registered counter for database nova_cell1 Sep 15 07:37:53.444462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_db.sqlalchemy.engines [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:37:53.446178 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_db.sqlalchemy.engines [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:37:53.450856 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writer thread running {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:37:53.457224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writer thread running {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:37:53.534806 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writer thread running {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:37:53.545422 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO dbcounter [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Registered counter for database nova_cell0 Sep 15 07:37:53.552775 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_db.sqlalchemy.engines [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:37:53.557778 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writer thread running {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:37:53.606492 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO dbcounter [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Registered counter for database nova_cell0 Sep 15 07:37:53.614296 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_db.sqlalchemy.engines [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 07:37:53.620423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writer thread running {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 07:37:53.895288 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: WARNING keystonemiddleware.auth_token [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 07:37:53.902599 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: WARNING keystonemiddleware.auth_token [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 07:37:53.957895 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: WARNING keystonemiddleware.auth_token [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 07:37:53.965324 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: WARNING keystonemiddleware.auth_token [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 07:37:54.263162 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: WARNING keystonemiddleware.auth_token [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 07:37:54.269746 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: WARNING keystonemiddleware.auth_token [None req-2af6c021-0bf6-4444-a1e0-be7d8670374f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 07:37:54.275036 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c40bb549c0 pid: 132674 (default app) Sep 15 07:37:54.316262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: WARNING keystonemiddleware.auth_token [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 07:37:54.322306 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: WARNING keystonemiddleware.auth_token [None req-652c9dd9-4e1d-48b5-aaf1-82796c218d0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 07:37:54.327627 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c40bb549c0 pid: 132673 (default app) Sep 15 07:38:31.877343 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=3 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:31.878210 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=3 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:31.878979 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=3 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:31.879920 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=3 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:32.041409 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=3 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:32.042498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=3 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:32.043362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=3 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:32.044342 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=3 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:33.180712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9e8decc4-dbb3-42f9-9e1b-5ff378aadb1f tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Action: 'create', calling method: .version_select at 0x7ff36d8d74c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1564326799"}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:38:33.227114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-065618c8-f0ca-42cc-a13c-d7d79d7394ff tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] Action: 'create', calling method: .version_select at 0x7ff36d8d7430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2131910914", "metadata": {"Type": "work"}}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:38:35.700853 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9e8decc4-dbb3-42f9-9e1b-5ff378aadb1f tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.833434 Sep 15 07:38:35.702384 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Sep 15 07:38:31 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3837 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 07:38:35.729897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-96a188b6-aad6-4bdd-8239-51293aa74530 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d7a73a0>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:35.753098 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-065618c8-f0ca-42cc-a13c-d7d79d7394ff tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.717365 Sep 15 07:38:35.754398 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 1/2] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 15 07:38:32 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3720 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 15 07:38:35.771959 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9bc91ce1-73a5-476d-a7dc-f7da18f26820 tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] Calling method '.version_select at 0x7ff36d7ab310>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:36.031206 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-96a188b6-aad6-4bdd-8239-51293aa74530 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b" status: 200 len: 345 microversion: 2.1 time: 0.310692 Sep 15 07:38:36.032318 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:35 2022] GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b => generated 345 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:36.058030 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9bc91ce1-73a5-476d-a7dc-f7da18f26820 tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c" status: 200 len: 353 microversion: 2.1 time: 0.291347 Sep 15 07:38:36.059242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:35 2022] GET /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c => generated 353 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:38:37.069571 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-88d8eadf-b2ac-4b7e-8373-8c2cd2f09777 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d7a7a60>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:37.075468 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9f2fa358-bf20-4362-a9d0-ce4f28902b49 tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] Calling method '.version_select at 0x7ff36d7ab9d0>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:37.154646 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9f2fa358-bf20-4362-a9d0-ce4f28902b49 tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c" status: 200 len: 354 microversion: 2.1 time: 0.084705 Sep 15 07:38:37.162792 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:37 2022] GET /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:37.169243 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6cebc6e6-e556-4d79-a2ee-d5e50f06e081 tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] Calling method '.version_select at 0x7ff36d7440d0>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:37.508460 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-88d8eadf-b2ac-4b7e-8373-8c2cd2f09777 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b" status: 200 len: 346 microversion: 2.1 time: 0.466457 Sep 15 07:38:37.509318 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:37 2022] GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b => generated 346 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:37.523219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9a716515-5517-42ed-b9b5-50a8a9226dfd tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Action: 'create', calling method: .version_select at 0x7ff36d7430d0>, body: {"snapshot": {"volume_id": "e9909d83-cd13-44f7-9eba-19bfa2574f7b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1523754765"}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:38:37.557338 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6cebc6e6-e556-4d79-a2ee-d5e50f06e081 tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c" status: 200 len: 354 microversion: 2.1 time: 0.392555 Sep 15 07:38:37.558151 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:37 2022] GET /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c => generated 354 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:38:37.574591 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-be9e6cd4-ee04-4cba-b6ec-ce886ec3fc31 tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] Calling method '.version_select at 0x7ff36d7abd30>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:38.245817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-be9e6cd4-ee04-4cba-b6ec-ce886ec3fc31 tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c" status: 202 len: 0 microversion: 2.1 time: 0.676147 Sep 15 07:38:38.247439 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 15 07:38:37 2022] DELETE /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:38:38.255858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c51258ea-778b-4a49-a118-bd50ba738b65 tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] Calling method '.version_select at 0x7ff36d7ab670>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:38.283174 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9a716515-5517-42ed-b9b5-50a8a9226dfd tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.764395 Sep 15 07:38:38.284514 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 4/9] 10.222.0.42 () {60 vars in 1162 bytes} [Thu Sep 15 07:38:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:38:38.302746 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-847baf32-4a45-4f01-976b-2d1b714602dd tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d743940>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:38.407203 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c51258ea-778b-4a49-a118-bd50ba738b65 tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c" status: 200 len: 353 microversion: 2.1 time: 0.155175 Sep 15 07:38:38.408222 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 6/10] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:38 2022] GET /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:38.461222 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-847baf32-4a45-4f01-976b-2d1b714602dd tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee" status: 200 len: 287 microversion: 2.1 time: 0.168071 Sep 15 07:38:38.462342 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 5/11] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 15 07:38:38 2022] GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:38:38.493322 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1d3daade-ddb6-4fd0-bbed-bd3641f7cdcb tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d744430>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:38.727552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-1d3daade-ddb6-4fd0-bbed-bd3641f7cdcb tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.252640 Sep 15 07:38:38.728523 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 7/12] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Sep 15 07:38:38 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:38.743401 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7f5e5489-9ebd-4205-830b-282fc06c7525 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d743040>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:38.897125 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7f5e5489-9ebd-4205-830b-282fc06c7525 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee" status: 200 len: 287 microversion: 2.1 time: 0.160359 Sep 15 07:38:38.898492 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 6/13] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 15 07:38:38 2022] GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:39.423640 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-252ac2d6-e614-4692-83c3-185820df163c tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] Calling method '.version_select at 0x7ff36d7ab430>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:39.477946 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-252ac2d6-e614-4692-83c3-185820df163c tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] HTTP exception thrown: Volume 7485dfca-58a6-4003-9817-0a5652e8285c could not be found. Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-252ac2d6-e614-4692-83c3-185820df163c tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] Request method failure captured: Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c HTTP/1.1 Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItZ3fbp5DBqOqSDaxbF7qRYLSCwSnMM63hF9-prG1bnOsoZKW6O67XJZcYW8XcCG7jazK-yYIRr3gmZzNAQxn_rcQf9TiCRe3yX9zWB2PaPPo3fkDJU4INDpmLfMJqgkEKAlIsx97LyXgz6IvCuMqA4HoG9Rcf3UJ4s5apf86PnNAv8 Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 3dfbf0bb45d9413296e05adb32a63fb0 Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-VolumesGetTestJSON-799470497 Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:38:39.482153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3dfbf0bb45d9413296e05adb32a63fb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3dfbf0bb45d9413296e05adb32a63fb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3dfbf0bb45d9413296e05adb32a63fb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3dfbf0bb45d9413296e05adb32a63fb0"}]}] Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-VolumesGetTestJSON-799470497 Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 3dfbf0bb45d9413296e05adb32a63fb0 Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-VolumesGetTestJSON-799470497 Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-VolumesGetTestJSON-799470497-project Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 5120d3da839c487e917b8bff45044f6e Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-VolumesGetTestJSON-799470497-project Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Volume 7485dfca-58a6-4003-9817-0a5652e8285c could not be found. Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '7485dfca-58a6-4003-9817-0a5652e8285c'} Sep 15 07:38:39.483211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7485dfca-58a6-4003-9817-0a5652e8285c could not be found. (HTTP 404) (Request-ID: req-1d92ed16-cafb-44c5-8c03-84e065334ea5) Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:39.483804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 07:38:39.484655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7485dfca-58a6-4003-9817-0a5652e8285c could not be found. Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 07:38:39.486547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7485dfca-58a6-4003-9817-0a5652e8285c could not be found. Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7485dfca-58a6-4003-9817-0a5652e8285c could not be found. Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-252ac2d6-e614-4692-83c3-185820df163c tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] Returning 404 to user: Volume 7485dfca-58a6-4003-9817-0a5652e8285c could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-252ac2d6-e614-4692-83c3-185820df163c tempest-VolumesGetTestJSON-799470497 tempest-VolumesGetTestJSON-799470497-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c" status: 404 len: 109 microversion: 2.1 time: 0.065158 Sep 15 07:38:39.487397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 8/14] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:39 2022] GET /compute/v2.1/os-volumes/7485dfca-58a6-4003-9817-0a5652e8285c => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:38:39.918892 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1fa4dad0-2e4b-4199-891c-1ad420a361ac tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d7a7e50>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:40.000277 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1fa4dad0-2e4b-4199-891c-1ad420a361ac tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee" status: 200 len: 287 microversion: 2.1 time: 0.094572 Sep 15 07:38:40.001590 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 7/15] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 15 07:38:39 2022] GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:38:41.014866 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-fe0d1ebf-7b7c-4466-869c-f79c7e53e1a7 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36e102af0>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:41.082020 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-fe0d1ebf-7b7c-4466-869c-f79c7e53e1a7 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee" status: 200 len: 287 microversion: 2.1 time: 0.071296 Sep 15 07:38:41.082673 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 15 07:38:41 2022] GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:42.103233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-cc15fe09-8085-4802-885b-57e3236ae639 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d7a78b0>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:42.174991 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-cc15fe09-8085-4802-885b-57e3236ae639 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee" status: 200 len: 288 microversion: 2.1 time: 0.082096 Sep 15 07:38:42.181729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 15 07:38:42 2022] GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee => generated 288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:42.199980 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ac82bfb5-1152-4dd3-9991-a7d2371c292d tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d743d30>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:42.384433 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1211328875", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "networks": [{"uuid": "feb69ed5-4e75-4d22-8da6-ae0dd81d5093"}]}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:38:42.486657 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ac82bfb5-1152-4dd3-9991-a7d2371c292d tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee" status: 202 len: 0 microversion: 2.1 time: 0.297437 Sep 15 07:38:42.494877 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 9/18] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Sep 15 07:38:42 2022] DELETE /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:38:42.508550 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3ac2aaf6-a2dd-474d-84f0-08abb5c44ede tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d743700>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:42.555217 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] validate_networks() for [('feb69ed5-4e75-4d22-8da6-ae0dd81d5093', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:38:42.667861 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3ac2aaf6-a2dd-474d-84f0-08abb5c44ede tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee" status: 200 len: 287 microversion: 2.1 time: 0.171676 Sep 15 07:38:42.669746 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 10/19] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 15 07:38:42 2022] GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee => generated 287 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:43.682157 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5ab63204-2241-4df2-88a7-e295180ed25f tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d8d74c0>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:43.738075 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-5ab63204-2241-4df2-88a7-e295180ed25f tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] HTTP exception thrown: Snapshot 41fddb68-0bda-4171-b8c1-0c091559eeee could not be found. Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5ab63204-2241-4df2-88a7-e295180ed25f tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Request method failure captured: Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee HTTP/1.1 Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItZ3_B_TK3DTlJGsQd58gt4PiuVXgt_-bv-6uqTd_VF4zbdoLy53QKfPVh_7pJoa2Gl8plppHjW-DnSuBCdRWbB7JjF0knl_E2eZ-5dSefANra_fYBthkFc0_RJDo_91mxTBGYsG-WN0TWNIDBWaROgNu0ZojmNj_kx1MlfHusF3KDw Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: bc55a1b8894a43bdaeef8a3ae59bd1dc Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:38:43.744035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}] Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: bc55a1b8894a43bdaeef8a3ae59bd1dc Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-VolumesSnapshotsTestJSON-1654354329-project Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 370896120c7d4fc7b0bf9548336f9382 Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1654354329-project Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Snapshot 41fddb68-0bda-4171-b8c1-0c091559eeee could not be found. Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '41fddb68-0bda-4171-b8c1-0c091559eeee'} Sep 15 07:38:43.744999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 41fddb68-0bda-4171-b8c1-0c091559eeee could not be found. (HTTP 404) (Request-ID: req-7c7978b4-fbd9-4880-9f3b-3414ae397ad3) Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:43.745640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 07:38:43.746557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 41fddb68-0bda-4171-b8c1-0c091559eeee could not be found. Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 15 07:38:43.747587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 41fddb68-0bda-4171-b8c1-0c091559eeee could not be found. Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 41fddb68-0bda-4171-b8c1-0c091559eeee could not be found. Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:43.748477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5ab63204-2241-4df2-88a7-e295180ed25f tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Returning 404 to user: Snapshot 41fddb68-0bda-4171-b8c1-0c091559eeee could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:38:43.749111 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5ab63204-2241-4df2-88a7-e295180ed25f tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee" status: 404 len: 111 microversion: 2.1 time: 0.070326 Sep 15 07:38:43.752533 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 11/20] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 15 07:38:43 2022] GET /compute/v2.1/os-snapshots/41fddb68-0bda-4171-b8c1-0c091559eeee => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:38:43.759776 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-59fb2e39-6797-4dd9-8bd3-d5879ee11241 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d7a7dc0>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:44.072771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-59fb2e39-6797-4dd9-8bd3-d5879ee11241 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b" status: 202 len: 0 microversion: 2.1 time: 0.318965 Sep 15 07:38:44.073414 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 12/21] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 15 07:38:43 2022] DELETE /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:38:44.081463 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c0743e23-5034-4770-b475-682728d0dda0 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d725310>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:44.081819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:38:44.082775 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:38:44.083915 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:38:44.085320 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:38:44.085955 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:38:44.116894 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:44.117702 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:44.118531 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:44.119557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:44.121144 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:44.139359 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:44.177358 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c0743e23-5034-4770-b475-682728d0dda0 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b" status: 200 len: 345 microversion: 2.1 time: 0.099607 Sep 15 07:38:44.178532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 13/22] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:44 2022] GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:38:44.249197 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Getting quotas for project 9836d4c25e0e46a8a6245bb7b74c55ce. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:38:44.270426 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Getting quotas for user 1d51e6d2afe1436e8a65b895c83bdd38 and project 9836d4c25e0e46a8a6245bb7b74c55ce. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:38:44.294358 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:38:44.299969 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:38:44.556013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-855fa722-1079-4d9d-913b-5d87c3eb87d6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.460042 Sep 15 07:38:44.557272 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 10/23] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:38:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:38:44.570145 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2b08efb7-e0dd-4d78-9463-f7afcc984770 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:44.577896 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2b08efb7-e0dd-4d78-9463-f7afcc984770 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:38:44.849490 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2b08efb7-e0dd-4d78-9463-f7afcc984770 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:44.898903 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2b08efb7-e0dd-4d78-9463-f7afcc984770 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1215 microversion: 2.1 time: 0.333555 Sep 15 07:38:44.899497 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 14/24] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:38:44 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1215 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:38:45.195917 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-279dac47-a9a4-4248-a04c-cd96206f14f8 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d639670>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:45.296795 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-279dac47-a9a4-4248-a04c-cd96206f14f8 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b" status: 200 len: 345 microversion: 2.1 time: 0.106751 Sep 15 07:38:45.298098 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 11/25] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:45 2022] GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b => generated 345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:45.926546 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-96a9fb02-220f-46b4-bb39-61139db2a525 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:45.929721 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-96a9fb02-220f-46b4-bb39-61139db2a525 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:38:46.025568 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-96a9fb02-220f-46b4-bb39-61139db2a525 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:46.034536 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-96a9fb02-220f-46b4-bb39-61139db2a525 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1215 microversion: 2.1 time: 0.115932 Sep 15 07:38:46.051714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 15/26] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:38:45 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:38:46.313206 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5babc44c-c125-4d5f-a473-faa8cdaa6ed4 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d639dc0>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:46.502560 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-5babc44c-c125-4d5f-a473-faa8cdaa6ed4 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] HTTP exception thrown: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5babc44c-c125-4d5f-a473-faa8cdaa6ed4 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Request method failure captured: Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b HTTP/1.1 Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItZ3_B_TK3DTlJGsQd58gt4PiuVXgt_-bv-6uqTd_VF4zbdoLy53QKfPVh_7pJoa2Gl8plppHjW-DnSuBCdRWbB7JjF0knl_E2eZ-5dSefANra_fYBthkFc0_RJDo_91mxTBGYsG-WN0TWNIDBWaROgNu0ZojmNj_kx1MlfHusF3KDw Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: bc55a1b8894a43bdaeef8a3ae59bd1dc Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:38:46.505070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}] Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: bc55a1b8894a43bdaeef8a3ae59bd1dc Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-VolumesSnapshotsTestJSON-1654354329-project Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 370896120c7d4fc7b0bf9548336f9382 Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1654354329-project Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': 'e9909d83-cd13-44f7-9eba-19bfa2574f7b'} Sep 15 07:38:46.507073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. (HTTP 404) (Request-ID: req-ab1dea39-70c2-4d33-98ac-dc21bfdc1f4a) Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:46.508094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 07:38:46.509304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 07:38:46.510552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.511845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5babc44c-c125-4d5f-a473-faa8cdaa6ed4 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Returning 404 to user: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:38:46.515324 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5babc44c-c125-4d5f-a473-faa8cdaa6ed4 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b" status: 404 len: 109 microversion: 2.1 time: 0.204515 Sep 15 07:38:46.524478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 12/27] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:46 2022] GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b => generated 109 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:38:46.528454 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b777174c-d614-460c-a17f-855a88c266c6 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d67e040>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:46.650813 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-b777174c-d614-460c-a17f-855a88c266c6 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] HTTP exception thrown: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b777174c-d614-460c-a17f-855a88c266c6 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Request method failure captured: Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: DELETE /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b HTTP/1.1 Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItZ3_B_TK3DTlJGsQd58gt4PiuVXgt_-bv-6uqTd_VF4zbdoLy53QKfPVh_7pJoa2Gl8plppHjW-DnSuBCdRWbB7JjF0knl_E2eZ-5dSefANra_fYBthkFc0_RJDo_91mxTBGYsG-WN0TWNIDBWaROgNu0ZojmNj_kx1MlfHusF3KDw Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: bc55a1b8894a43bdaeef8a3ae59bd1dc Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:38:46.653266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}] Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: bc55a1b8894a43bdaeef8a3ae59bd1dc Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-VolumesSnapshotsTestJSON-1654354329-project Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 370896120c7d4fc7b0bf9548336f9382 Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1654354329-project Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': 'e9909d83-cd13-44f7-9eba-19bfa2574f7b'} Sep 15 07:38:46.654387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. (HTTP 404) (Request-ID: req-1f60bf7d-4eeb-4509-972f-a9e55f693031) Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:46.655601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 07:38:46.656572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 07:38:46.657532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:38:46.658933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.658933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.658933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:46.658933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.658933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.658933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:38:46.658933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:38:46.658933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:38:46.658933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:38:46.658933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.658933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.661394 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b777174c-d614-460c-a17f-855a88c266c6 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Returning 404 to user: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:38:46.663085 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b777174c-d614-460c-a17f-855a88c266c6 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b" status: 404 len: 109 microversion: 2.1 time: 0.138005 Sep 15 07:38:46.664153 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 16/28] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 15 07:38:46 2022] DELETE /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:38:46.672788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3a9bf502-c88d-4238-99a0-0d94fc313d22 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Calling method '.version_select at 0x7ff36d639700>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:46.798736 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-3a9bf502-c88d-4238-99a0-0d94fc313d22 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] HTTP exception thrown: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3a9bf502-c88d-4238-99a0-0d94fc313d22 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Request method failure captured: Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b HTTP/1.1 Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItZ3_B_TK3DTlJGsQd58gt4PiuVXgt_-bv-6uqTd_VF4zbdoLy53QKfPVh_7pJoa2Gl8plppHjW-DnSuBCdRWbB7JjF0knl_E2eZ-5dSefANra_fYBthkFc0_RJDo_91mxTBGYsG-WN0TWNIDBWaROgNu0ZojmNj_kx1MlfHusF3KDw Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: bc55a1b8894a43bdaeef8a3ae59bd1dc Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:38:46.801708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc55a1b8894a43bdaeef8a3ae59bd1dc"}]}] Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: bc55a1b8894a43bdaeef8a3ae59bd1dc Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1654354329 Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-VolumesSnapshotsTestJSON-1654354329-project Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 370896120c7d4fc7b0bf9548336f9382 Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1654354329-project Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': 'e9909d83-cd13-44f7-9eba-19bfa2574f7b'} Sep 15 07:38:46.802740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. (HTTP 404) (Request-ID: req-358fde96-cda6-4c59-8cdc-76cc1f0fcb59) Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:46.803508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 07:38:46.804379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 07:38:46.812255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3a9bf502-c88d-4238-99a0-0d94fc313d22 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] Returning 404 to user: Volume e9909d83-cd13-44f7-9eba-19bfa2574f7b could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3a9bf502-c88d-4238-99a0-0d94fc313d22 tempest-VolumesSnapshotsTestJSON-1654354329 tempest-VolumesSnapshotsTestJSON-1654354329-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b" status: 404 len: 109 microversion: 2.1 time: 0.135026 Sep 15 07:38:46.813642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 13/29] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:46 2022] GET /compute/v2.1/os-volumes/e9909d83-cd13-44f7-9eba-19bfa2574f7b => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:38:47.067783 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9c98bf6f-d9aa-4a0c-8245-eaee5a6e943e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:47.069211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-9c98bf6f-d9aa-4a0c-8245-eaee5a6e943e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:38:47.262892 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-9c98bf6f-d9aa-4a0c-8245-eaee5a6e943e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:47.297424 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9c98bf6f-d9aa-4a0c-8245-eaee5a6e943e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1215 microversion: 2.1 time: 0.236143 Sep 15 07:38:47.298637 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 14/30] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:38:47 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:38:47.636631 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4cef0639-1f96-4a79-80af-be616af3e9f4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: .version_select at 0x7ff36d6eba60>, body: {"keypair": {"name": "tempest-keypair-124479253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLrV2vXWIERoUT8kw/BD/2XPmoFMLTuQpsn9Wt02aJ5i1nLDRVS+bGIb5cZ2V5S54/sbwgVbKP0bzxI45ERihg6tdIwsJF6KBY/oHiTwNSn51On4YSDKsUQs4KisYSLUw=="}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:38:47.761081 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-4cef0639-1f96-4a79-80af-be616af3e9f4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for project 14017d5edbbd4068b529d5d92444182a. Resources: {'key_pairs'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:38:47.782118 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-4cef0639-1f96-4a79-80af-be616af3e9f4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for user 5e0c8d7aa4db455a94631becf212866f and project 14017d5edbbd4068b529d5d92444182a. Resources: {'key_pairs'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:38:47.994494 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4cef0639-1f96-4a79-80af-be616af3e9f4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.273433 Sep 15 07:38:47.996222 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 17/31] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 15 07:38:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:38:48.325362 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e9150091-443a-480f-bcda-d65bbf2a86b4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:48.326694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e9150091-443a-480f-bcda-d65bbf2a86b4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:38:48.346502 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9150091-443a-480f-bcda-d65bbf2a86b4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:48.349496 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9150091-443a-480f-bcda-d65bbf2a86b4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:48.353427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9150091-443a-480f-bcda-d65bbf2a86b4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:48.354295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9150091-443a-480f-bcda-d65bbf2a86b4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:48.354774 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9150091-443a-480f-bcda-d65bbf2a86b4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:48.362134 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9150091-443a-480f-bcda-d65bbf2a86b4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:48.484749 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d62cb7a1-72c9-480e-a1f2-6e94a1b080e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Action: 'create', calling method: .version_select at 0x7ff36cdd45e0>, body: {"keypair": {"name": "tempest-keypair-331169569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJntZFkM8QCnhJX2skXX0aNUVsTaKI8JsQcgSRxZtKfko1Ht+zgW4fn+XxdW/neWk/u+zVd0arWB8uFp4T7vYezFicBZevtVZJZVTNPcQKZ8+rSqyTh431zjhlj7NvWoA=="}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:38:48.526999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-d62cb7a1-72c9-480e-a1f2-6e94a1b080e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Getting quotas for project b4a8f2664964492e9c80a595ed043c71. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:38:48.531549 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-d62cb7a1-72c9-480e-a1f2-6e94a1b080e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Getting quotas for user 56c2f854cf074b1ba2571766b7f2fc51 and project b4a8f2664964492e9c80a595ed043c71. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:38:48.623514 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e9150091-443a-480f-bcda-d65bbf2a86b4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:48.636622 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e9150091-443a-480f-bcda-d65bbf2a86b4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1219 microversion: 2.1 time: 0.316729 Sep 15 07:38:48.638246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 18/32] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:38:48 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1219 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:38:48.731822 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d62cb7a1-72c9-480e-a1f2-6e94a1b080e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.592546 Sep 15 07:38:48.732533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 15/33] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Sep 15 07:38:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 595 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 15 07:38:49.463816 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b51982f9-373e-4de0-b745-b184a9a47b58 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] Calling method '.version_select at 0x7ff36d580280>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:49.585717 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b51982f9-373e-4de0-b745-b184a9a47b58 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/60031dc5-9fcc-4069-bbd6-89807634bb9a" status: 200 len: 350 microversion: 2.1 time: 0.139920 Sep 15 07:38:49.587566 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 19/34] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:49 2022] GET /compute/v2.1/os-volumes/60031dc5-9fcc-4069-bbd6-89807634bb9a => generated 350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:49.666742 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bbe33b8e-df5b-48ac-881c-9b6f57f7aa5b tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:49.667367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bbe33b8e-df5b-48ac-881c-9b6f57f7aa5b tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:38:49.687938 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe33b8e-df5b-48ac-881c-9b6f57f7aa5b tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:49.688687 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe33b8e-df5b-48ac-881c-9b6f57f7aa5b tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:49.691055 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe33b8e-df5b-48ac-881c-9b6f57f7aa5b tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:49.698163 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe33b8e-df5b-48ac-881c-9b6f57f7aa5b tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:49.698943 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe33b8e-df5b-48ac-881c-9b6f57f7aa5b tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:49.699560 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe33b8e-df5b-48ac-881c-9b6f57f7aa5b tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:50.316129 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bbe33b8e-df5b-48ac-881c-9b6f57f7aa5b tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:50.357076 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bbe33b8e-df5b-48ac-881c-9b6f57f7aa5b tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1267 microversion: 2.1 time: 0.699863 Sep 15 07:38:50.369225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 16/35] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:38:49 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1267 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:38:51.386712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-738297db-2e38-43d7-975d-05776617d30f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:51.387491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-738297db-2e38-43d7-975d-05776617d30f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:38:51.404136 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-738297db-2e38-43d7-975d-05776617d30f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:51.406470 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-738297db-2e38-43d7-975d-05776617d30f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:51.407335 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-738297db-2e38-43d7-975d-05776617d30f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:51.409134 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-738297db-2e38-43d7-975d-05776617d30f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:51.413892 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-738297db-2e38-43d7-975d-05776617d30f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:51.415022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-738297db-2e38-43d7-975d-05776617d30f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:51.670491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-738297db-2e38-43d7-975d-05776617d30f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:51.681282 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-738297db-2e38-43d7-975d-05776617d30f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1273 microversion: 2.1 time: 0.297137 Sep 15 07:38:51.682890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 20/36] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:38:51 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1273 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:38:51.986918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9149e9c8-fc83-46a7-bcb7-b027f24c50ab tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] Calling method '.version_select at 0x7ff36cd28940>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:52.099833 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9149e9c8-fc83-46a7-bcb7-b027f24c50ab tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/fd8f84ba-2341-4981-a650-332853ba462b" status: 200 len: 350 microversion: 2.1 time: 0.116691 Sep 15 07:38:52.101378 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 17/37] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:51 2022] GET /compute/v2.1/os-volumes/fd8f84ba-2341-4981-a650-332853ba462b => generated 350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:52.706410 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-cf62c6fd-1121-45b3-8412-cfa9dbfdbc05 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:52.710915 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-cf62c6fd-1121-45b3-8412-cfa9dbfdbc05 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:38:52.719872 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62c6fd-1121-45b3-8412-cfa9dbfdbc05 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:52.721101 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62c6fd-1121-45b3-8412-cfa9dbfdbc05 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:52.723696 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62c6fd-1121-45b3-8412-cfa9dbfdbc05 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:52.739727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62c6fd-1121-45b3-8412-cfa9dbfdbc05 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:52.743547 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62c6fd-1121-45b3-8412-cfa9dbfdbc05 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:52.745024 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62c6fd-1121-45b3-8412-cfa9dbfdbc05 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:53.309522 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-cf62c6fd-1121-45b3-8412-cfa9dbfdbc05 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:53.346620 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-cf62c6fd-1121-45b3-8412-cfa9dbfdbc05 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.618052 Sep 15 07:38:53.354176 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 21/38] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:38:52 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:38:54.377206 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:54.389865 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ba078abf-52ec-46d1-89a8-e368a9f2e0d4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:54.390795 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ba078abf-52ec-46d1-89a8-e368a9f2e0d4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:38:54.410362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ba078abf-52ec-46d1-89a8-e368a9f2e0d4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:54.414030 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ba078abf-52ec-46d1-89a8-e368a9f2e0d4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:54.418328 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ba078abf-52ec-46d1-89a8-e368a9f2e0d4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:54.420808 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ba078abf-52ec-46d1-89a8-e368a9f2e0d4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:54.422821 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ba078abf-52ec-46d1-89a8-e368a9f2e0d4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:54.425782 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ba078abf-52ec-46d1-89a8-e368a9f2e0d4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:54.489202 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b93fff90-9c22-4cef-94cb-7a42eb59ef97 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] Calling method '.version_select at 0x7ff36d5f1ee0>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:54.659805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b93fff90-9c22-4cef-94cb-7a42eb59ef97 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3d7a73bf-b5e0-4247-8b12-cba50d3b6919" status: 200 len: 351 microversion: 2.1 time: 0.177794 Sep 15 07:38:54.660378 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 22/39] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:38:54 2022] GET /compute/v2.1/os-volumes/3d7a73bf-b5e0-4247-8b12-cba50d3b6919 => generated 351 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:54.679810 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4afcaaaa-aa88-45a1-b00b-421ccc6c390a tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] Calling method '.version_select at 0x7ff36d54fb80>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:54.923773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4afcaaaa-aa88-45a1-b00b-421ccc6c390a tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.241530 Sep 15 07:38:54.923773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 23/40] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Sep 15 07:38:54 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:38:54.923773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-70079234", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be4fe7de-ab91-47eb-96fc-2000373fe74e"}], "security_groups": [{"name": "tempest-securitygroup--1592142916"}], "key_name": "tempest-keypair-124479253", "user_data": "}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:38:55.534478 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.network.neutron [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] validate_networks() for [('be4fe7de-ab91-47eb-96fc-2000373fe74e', None, None, None, None, None)] {{(pid=132674) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:38:55.666206 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ba078abf-52ec-46d1-89a8-e368a9f2e0d4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:55.674809 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ba078abf-52ec-46d1-89a8-e368a9f2e0d4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 1.298740 Sep 15 07:38:55.685428 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 18/41] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:38:54 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:38:55.690312 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-730fb6e6-1fa8-4712-b49f-57c2b91b6f99 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] Calling method '.version_select at 0x7ff36cd1e550>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:56.147185 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-730fb6e6-1fa8-4712-b49f-57c2b91b6f99 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.460275 Sep 15 07:38:56.150813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 19/42] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Sep 15 07:38:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:56.160858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1072925125", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b6b3bac-c651-487a-b144-89fba4985d6c"}], "security_groups": [{"name": "tempest-securitygroup--1272263753"}], "key_name": "tempest-keypair-331169569", "user_data": "}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:38:56.548347 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] validate_networks() for [('2b6b3bac-c651-487a-b144-89fba4985d6c', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:38:57.817880 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=8 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:38:58.265690 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Flavor limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:38:58.266582 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Image limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:38:58.268010 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Flavor pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:38:58.268444 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Image pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:38:58.268868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:38:58.287499 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:58.287999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:58.288559 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:58.289300 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:58.289789 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:58.293394 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:58.389493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:38:58.390589 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:38:58.391423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:38:58.392163 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:38:58.393199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:38:58.411444 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:58.413195 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:58.414445 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:58.417149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:58.418034 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:58.420747 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for project 14017d5edbbd4068b529d5d92444182a. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:38:58.420870 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:58.442809 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for user 5e0c8d7aa4db455a94631becf212866f and project 14017d5edbbd4068b529d5d92444182a. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:38:58.483342 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Getting quotas for project b4a8f2664964492e9c80a595ed043c71. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:38:58.503706 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Getting quotas for user 56c2f854cf074b1ba2571766b7f2fc51 and project b4a8f2664964492e9c80a595ed043c71. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:38:58.530480 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Going to run 1 instances... {{(pid=132674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:38:58.559215 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:38:58.584569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:38:58.589763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:38:58.861067 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f91fa181-a0c0-488b-8dfd-e760dde3c7eb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.945899 Sep 15 07:38:58.865002 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 24/43] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:38:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 3950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:38:58.872669 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8e1b8c32-d5be-4a66-a131-1f718d544a98 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.690848 Sep 15 07:38:58.873410 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 20/44] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Sep 15 07:38:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 07:38:58.876627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-8f920a93-2ac8-40f5-aebc-e2f2ec398bd0 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] Calling method '.version_select at 0x7ff36d4e2160>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:58.891932 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-16dcd488-605b-4ab3-912a-70525d2feae4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:58.892516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-16dcd488-605b-4ab3-912a-70525d2feae4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:38:58.974116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16dcd488-605b-4ab3-912a-70525d2feae4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:58.982125 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16dcd488-605b-4ab3-912a-70525d2feae4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:58.983093 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16dcd488-605b-4ab3-912a-70525d2feae4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:58.986102 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16dcd488-605b-4ab3-912a-70525d2feae4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:58.992337 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16dcd488-605b-4ab3-912a-70525d2feae4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:58.995096 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16dcd488-605b-4ab3-912a-70525d2feae4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:59.128638 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-8f920a93-2ac8-40f5-aebc-e2f2ec398bd0 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.256810 Sep 15 07:38:59.152405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 25/45] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Sep 15 07:38:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:38:59.421218 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-16dcd488-605b-4ab3-912a-70525d2feae4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:59.436122 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-16dcd488-605b-4ab3-912a-70525d2feae4 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.547445 Sep 15 07:38:59.440163 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 21/46] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:38:58 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:38:59.469290 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0e8aa699-5958-493c-a1fc-c334a3e520c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:59.469290 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0e8aa699-5958-493c-a1fc-c334a3e520c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:38:59.520855 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-349440cc-58d4-4d3c-9d0e-2cf36ec4dc64 req-43e760ee-48f6-4d3a-8642-d90412344416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0773d518-3cec-4a0a-87bf-eaa60c59154a", "tag": "a20fa119-e6e4-4748-9c88-82d94ae223c7"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:38:59.547693 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-349440cc-58d4-4d3c-9d0e-2cf36ec4dc64 req-43e760ee-48f6-4d3a-8642-d90412344416 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:59.548184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-349440cc-58d4-4d3c-9d0e-2cf36ec4dc64 req-43e760ee-48f6-4d3a-8642-d90412344416 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:59.550163 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-349440cc-58d4-4d3c-9d0e-2cf36ec4dc64 req-43e760ee-48f6-4d3a-8642-d90412344416 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:59.584069 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-349440cc-58d4-4d3c-9d0e-2cf36ec4dc64 req-43e760ee-48f6-4d3a-8642-d90412344416 service nova] Creating event network-changed:a20fa119-e6e4-4748-9c88-82d94ae223c7 for instance 0773d518-3cec-4a0a-87bf-eaa60c59154a on hv-cinder-82414 Sep 15 07:38:59.585752 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-349440cc-58d4-4d3c-9d0e-2cf36ec4dc64 req-43e760ee-48f6-4d3a-8642-d90412344416 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132674) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 07:38:59.586424 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-349440cc-58d4-4d3c-9d0e-2cf36ec4dc64 req-43e760ee-48f6-4d3a-8642-d90412344416 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132674) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 07:38:59.587946 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-987ad44d-7c86-4ccc-964b-e630fdf90875 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:59.588673 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-987ad44d-7c86-4ccc-964b-e630fdf90875 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:59.589403 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-987ad44d-7c86-4ccc-964b-e630fdf90875 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:59.589718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0e8aa699-5958-493c-a1fc-c334a3e520c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:59.591360 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-987ad44d-7c86-4ccc-964b-e630fdf90875 None None] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:38:59.592058 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-987ad44d-7c86-4ccc-964b-e630fdf90875 None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:38:59.593289 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-987ad44d-7c86-4ccc-964b-e630fdf90875 None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:38:59.605095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0e8aa699-5958-493c-a1fc-c334a3e520c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1239 microversion: 2.1 time: 0.165777 Sep 15 07:38:59.606263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 22/47] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:38:59 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1239 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:38:59.610987 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bc388dd6-b99f-47fb-849e-baa7534e87b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:59.611632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bc388dd6-b99f-47fb-849e-baa7534e87b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:38:59.626977 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.compute.rpcapi [None req-987ad44d-7c86-4ccc-964b-e630fdf90875 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 07:38:59.628264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-987ad44d-7c86-4ccc-964b-e630fdf90875 None None] Releasing lock "compute-rpcapi-router" {{(pid=132674) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 07:38:59.653478 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-987ad44d-7c86-4ccc-964b-e630fdf90875 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.504333 Sep 15 07:38:59.653989 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 26/48] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:59.683138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9c8c618e-6355-4435-9eb8-c0665b523317 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] Calling method '.version_select at 0x7ff36d4e21f0>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:38:59.718230 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bc388dd6-b99f-47fb-849e-baa7534e87b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:59.728162 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bc388dd6-b99f-47fb-849e-baa7534e87b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:59.730703 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bc388dd6-b99f-47fb-849e-baa7534e87b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:38:59.732074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bc388dd6-b99f-47fb-849e-baa7534e87b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1281 microversion: 2.20 time: 0.124860 Sep 15 07:38:59.733103 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 23/49] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:38:59 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1281 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:38:59.898872 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9c8c618e-6355-4435-9eb8-c0665b523317 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.243517 Sep 15 07:38:59.900070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 27/50] 10.222.0.42 () {58 vars in 1167 bytes} [Thu Sep 15 07:38:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:38:59.915745 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7c39391a-aa47-427f-8527-5edeb6b323e0 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] Calling method '.version_select at 0x7ff36cd831f0>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:00.021521 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7c39391a-aa47-427f-8527-5edeb6b323e0 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.109766 Sep 15 07:39:00.022304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 24/51] 10.222.0.42 () {58 vars in 1170 bytes} [Thu Sep 15 07:38:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:39:00.046397 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4ad2bb35-8b1b-48d4-8707-6a574a6caf16 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] Calling method '.version_select at 0x7ff36d5f1dc0>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:00.180369 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4ad2bb35-8b1b-48d4-8707-6a574a6caf16 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.146471 Sep 15 07:39:00.181094 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 28/52] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Sep 15 07:39:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:00.195652 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9cc860a9-9090-4743-b97b-9e35861b323a tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] Calling method '.version_select at 0x7ff36cccb9d0>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:00.419509 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9cc860a9-9090-4743-b97b-9e35861b323a tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.225473 Sep 15 07:39:00.419509 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 25/53] 10.222.0.42 () {58 vars in 1188 bytes} [Thu Sep 15 07:39:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:39:00.439094 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ae1fb35b-aee2-43bc-a90f-f90b1b6f3a68 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] Calling method '.version_select at 0x7ff36d55fdc0>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:00.462150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-217b0630-907e-4f73-acfe-604088380c08 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:00.463438 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-217b0630-907e-4f73-acfe-604088380c08 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:00.484808 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-217b0630-907e-4f73-acfe-604088380c08 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:00.486223 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-217b0630-907e-4f73-acfe-604088380c08 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:00.487234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-217b0630-907e-4f73-acfe-604088380c08 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:00.490676 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-217b0630-907e-4f73-acfe-604088380c08 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:00.490676 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-217b0630-907e-4f73-acfe-604088380c08 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:00.490920 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-217b0630-907e-4f73-acfe-604088380c08 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:00.700731 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ae1fb35b-aee2-43bc-a90f-f90b1b6f3a68 tempest-VolumesTestJSON-1281106219 tempest-VolumesTestJSON-1281106219-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.272397 Sep 15 07:39:00.700731 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 29/54] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Sep 15 07:39:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:00.708202 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6bd23f1e-bfac-4037-a2d0-1bbe7170e8ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:00.709159 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6bd23f1e-bfac-4037-a2d0-1bbe7170e8ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:00.857947 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6bd23f1e-bfac-4037-a2d0-1bbe7170e8ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:00.866100 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-217b0630-907e-4f73-acfe-604088380c08 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:00.880023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6bd23f1e-bfac-4037-a2d0-1bbe7170e8ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1239 microversion: 2.1 time: 0.178724 Sep 15 07:39:00.881479 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-217b0630-907e-4f73-acfe-604088380c08 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.423800 Sep 15 07:39:00.884068 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 26/55] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:00 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:00.895043 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 30/56] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:00 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1239 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:00.895722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8c6f6072-fbe3-4b02-abea-1b608413c2c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:00.896584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8c6f6072-fbe3-4b02-abea-1b608413c2c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:01.013121 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8c6f6072-fbe3-4b02-abea-1b608413c2c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:01.028282 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8c6f6072-fbe3-4b02-abea-1b608413c2c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:01.034407 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8c6f6072-fbe3-4b02-abea-1b608413c2c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:01.039610 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8c6f6072-fbe3-4b02-abea-1b608413c2c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1281 microversion: 2.20 time: 0.149727 Sep 15 07:39:01.041718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 27/57] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:00 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:39:01.906580 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4e82e7a5-9320-4b6e-92dd-1b0a7ad26fcf tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:01.907748 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-184e44b2-c529-4820-aa87-1d9a40920569 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:01.908517 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-184e44b2-c529-4820-aa87-1d9a40920569 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:01.908805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-4e82e7a5-9320-4b6e-92dd-1b0a7ad26fcf tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:01.923286 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-184e44b2-c529-4820-aa87-1d9a40920569 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:01.923794 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-184e44b2-c529-4820-aa87-1d9a40920569 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:01.924348 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-184e44b2-c529-4820-aa87-1d9a40920569 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:01.924947 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-184e44b2-c529-4820-aa87-1d9a40920569 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:01.926441 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-184e44b2-c529-4820-aa87-1d9a40920569 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:01.926883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-184e44b2-c529-4820-aa87-1d9a40920569 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:01.931732 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e82e7a5-9320-4b6e-92dd-1b0a7ad26fcf tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:01.934234 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e82e7a5-9320-4b6e-92dd-1b0a7ad26fcf tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:01.934892 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e82e7a5-9320-4b6e-92dd-1b0a7ad26fcf tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:01.943194 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e82e7a5-9320-4b6e-92dd-1b0a7ad26fcf tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:01.943988 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e82e7a5-9320-4b6e-92dd-1b0a7ad26fcf tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:01.950170 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e82e7a5-9320-4b6e-92dd-1b0a7ad26fcf tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:02.136108 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-184e44b2-c529-4820-aa87-1d9a40920569 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:02.152491 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-184e44b2-c529-4820-aa87-1d9a40920569 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1243 microversion: 2.1 time: 0.249841 Sep 15 07:39:02.153082 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 28/58] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:01 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1243 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:02.157729 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:02.158340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:02.179859 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:02.180652 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:02.181104 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:02.181846 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:02.182303 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:02.190335 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:02.301656 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4e82e7a5-9320-4b6e-92dd-1b0a7ad26fcf tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:02.314734 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4e82e7a5-9320-4b6e-92dd-1b0a7ad26fcf tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.412084 Sep 15 07:39:02.318269 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 31/59] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:01 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:02.356598 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:02.366603 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:02.377766 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:02.377766 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-31262d76-5979-4476-9262-00afe182ab09 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1285 microversion: 2.20 time: 0.215695 Sep 15 07:39:02.377766 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 29/60] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:02 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1285 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:39:03.178162 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-930e646d-af8a-4834-8c2c-c413b5dbaedb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:03.178862 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-930e646d-af8a-4834-8c2c-c413b5dbaedb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:03.193490 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-930e646d-af8a-4834-8c2c-c413b5dbaedb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:03.194017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-930e646d-af8a-4834-8c2c-c413b5dbaedb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:03.195748 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-930e646d-af8a-4834-8c2c-c413b5dbaedb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:03.195748 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-930e646d-af8a-4834-8c2c-c413b5dbaedb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:03.203184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-930e646d-af8a-4834-8c2c-c413b5dbaedb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:03.203564 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-930e646d-af8a-4834-8c2c-c413b5dbaedb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:03.342687 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c1305120-eff2-46ee-889d-55aff0ae243d tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:03.343882 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c1305120-eff2-46ee-889d-55aff0ae243d tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:03.355232 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1305120-eff2-46ee-889d-55aff0ae243d tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:03.355983 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1305120-eff2-46ee-889d-55aff0ae243d tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:03.356592 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1305120-eff2-46ee-889d-55aff0ae243d tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:03.357512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1305120-eff2-46ee-889d-55aff0ae243d tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:03.358489 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1305120-eff2-46ee-889d-55aff0ae243d tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:03.359074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1305120-eff2-46ee-889d-55aff0ae243d tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:03.381078 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-930e646d-af8a-4834-8c2c-c413b5dbaedb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:03.413411 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-930e646d-af8a-4834-8c2c-c413b5dbaedb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1235 microversion: 2.1 time: 0.239273 Sep 15 07:39:03.422208 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 32/61] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:03 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1235 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:03.442648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:03.445440 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:03.454888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:03.456024 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:03.458027 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:03.479782 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:03.481092 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:03.482672 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:03.608674 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:03.631234 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:03.633778 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:03.637100 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c3c3ad95-3c01-4074-8c30-355282d75576 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1277 microversion: 2.20 time: 0.212701 Sep 15 07:39:03.640061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 33/62] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:03 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:39:03.667760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c1305120-eff2-46ee-889d-55aff0ae243d tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:03.678432 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c1305120-eff2-46ee-889d-55aff0ae243d tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.339544 Sep 15 07:39:03.680481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:03 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:39:04.441147 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ed230d3a-4c2c-41f6-bbfa-dfcd3608ca3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:04.442725 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ed230d3a-4c2c-41f6-bbfa-dfcd3608ca3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:04.458257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed230d3a-4c2c-41f6-bbfa-dfcd3608ca3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:04.459638 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed230d3a-4c2c-41f6-bbfa-dfcd3608ca3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:04.460955 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed230d3a-4c2c-41f6-bbfa-dfcd3608ca3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:04.468843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed230d3a-4c2c-41f6-bbfa-dfcd3608ca3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:04.469722 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed230d3a-4c2c-41f6-bbfa-dfcd3608ca3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:04.470732 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed230d3a-4c2c-41f6-bbfa-dfcd3608ca3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:04.599673 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ed230d3a-4c2c-41f6-bbfa-dfcd3608ca3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:04.612281 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ed230d3a-4c2c-41f6-bbfa-dfcd3608ca3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1291 microversion: 2.1 time: 0.177099 Sep 15 07:39:04.614806 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 34/64] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:04 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1291 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:04.669649 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:04.670293 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:04.687654 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:04.693134 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:04.694322 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:04.699893 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:04.701054 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:04.706139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-89b8f162-af5f-4755-ae1d-6d81ec716b7c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:04.706139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-89b8f162-af5f-4755-ae1d-6d81ec716b7c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:04.707285 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:04.713214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b8f162-af5f-4755-ae1d-6d81ec716b7c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:04.713743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b8f162-af5f-4755-ae1d-6d81ec716b7c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:04.714194 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b8f162-af5f-4755-ae1d-6d81ec716b7c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:04.719276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b8f162-af5f-4755-ae1d-6d81ec716b7c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:04.720252 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b8f162-af5f-4755-ae1d-6d81ec716b7c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:04.721504 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b8f162-af5f-4755-ae1d-6d81ec716b7c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:04.805328 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:04.814070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:04.815527 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:04.816625 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-be9ba559-49dd-4839-887c-ad3abde97f2c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1277 microversion: 2.20 time: 0.152106 Sep 15 07:39:04.817315 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 31/65] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:04 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:39:04.959650 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-89b8f162-af5f-4755-ae1d-6d81ec716b7c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:04.976945 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-89b8f162-af5f-4755-ae1d-6d81ec716b7c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.276720 Sep 15 07:39:04.977556 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 35/66] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:04 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:05.642746 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d7973726-19cd-4373-b910-9377f9fe473b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:05.643441 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d7973726-19cd-4373-b910-9377f9fe473b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:05.652443 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7973726-19cd-4373-b910-9377f9fe473b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:05.653600 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7973726-19cd-4373-b910-9377f9fe473b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:05.654155 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7973726-19cd-4373-b910-9377f9fe473b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:05.655030 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7973726-19cd-4373-b910-9377f9fe473b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:05.655837 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7973726-19cd-4373-b910-9377f9fe473b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:05.656533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7973726-19cd-4373-b910-9377f9fe473b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:05.724543 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d7973726-19cd-4373-b910-9377f9fe473b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:05.732907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d7973726-19cd-4373-b910-9377f9fe473b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1299 microversion: 2.1 time: 0.094250 Sep 15 07:39:05.733626 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 32/67] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:05 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:05.844423 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:05.848718 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:05.856534 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:05.857031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:05.857467 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:05.859187 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:05.859651 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:05.860082 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:05.927058 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:05.936884 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:05.938389 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:05.940484 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-391c61e4-c63d-4cc2-b43d-94f0d6e7d6da tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1333 microversion: 2.20 time: 0.101904 Sep 15 07:39:05.941649 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 36/68] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:05 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:39:06.000842 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4b1c7c54-8b2d-4b0c-afe4-df174ddb8d6e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:06.007839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4b1c7c54-8b2d-4b0c-afe4-df174ddb8d6e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:06.008478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b1c7c54-8b2d-4b0c-afe4-df174ddb8d6e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:06.008478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b1c7c54-8b2d-4b0c-afe4-df174ddb8d6e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:06.008909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b1c7c54-8b2d-4b0c-afe4-df174ddb8d6e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:06.009630 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b1c7c54-8b2d-4b0c-afe4-df174ddb8d6e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:06.010089 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b1c7c54-8b2d-4b0c-afe4-df174ddb8d6e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:06.010512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b1c7c54-8b2d-4b0c-afe4-df174ddb8d6e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:06.165119 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4b1c7c54-8b2d-4b0c-afe4-df174ddb8d6e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:06.173940 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4b1c7c54-8b2d-4b0c-afe4-df174ddb8d6e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.177773 Sep 15 07:39:06.176038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 33/69] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:05 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:06.767169 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f95576ef-d45f-46cf-98cf-897f17dc2c30 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:06.768169 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f95576ef-d45f-46cf-98cf-897f17dc2c30 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:06.778710 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f95576ef-d45f-46cf-98cf-897f17dc2c30 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:06.779526 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f95576ef-d45f-46cf-98cf-897f17dc2c30 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:06.780188 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f95576ef-d45f-46cf-98cf-897f17dc2c30 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:06.781196 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f95576ef-d45f-46cf-98cf-897f17dc2c30 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:06.783360 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f95576ef-d45f-46cf-98cf-897f17dc2c30 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:06.784127 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f95576ef-d45f-46cf-98cf-897f17dc2c30 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:06.955825 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f95576ef-d45f-46cf-98cf-897f17dc2c30 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:06.965370 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f95576ef-d45f-46cf-98cf-897f17dc2c30 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1309 microversion: 2.1 time: 0.205201 Sep 15 07:39:06.966689 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 37/70] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:06 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1309 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:06.967269 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:06.967964 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:06.978426 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:06.981397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:06.982831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:06.986358 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:06.987273 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:06.989375 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:07.097742 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:07.111567 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:07.114043 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:07.116082 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0f3e5a76-7adc-4a41-aca6-80f766f0ea96 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1333 microversion: 2.20 time: 0.153334 Sep 15 07:39:07.118300 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 34/71] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:06 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1333 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:39:07.198577 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b795b0b4-03b2-4ff0-ae5d-006b82819b43 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:07.199404 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b795b0b4-03b2-4ff0-ae5d-006b82819b43 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:07.205635 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b795b0b4-03b2-4ff0-ae5d-006b82819b43 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:07.206148 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b795b0b4-03b2-4ff0-ae5d-006b82819b43 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:07.206975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b795b0b4-03b2-4ff0-ae5d-006b82819b43 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:07.207298 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b795b0b4-03b2-4ff0-ae5d-006b82819b43 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:07.207752 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b795b0b4-03b2-4ff0-ae5d-006b82819b43 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:07.208176 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b795b0b4-03b2-4ff0-ae5d-006b82819b43 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:07.587230 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b795b0b4-03b2-4ff0-ae5d-006b82819b43 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:07.599650 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b795b0b4-03b2-4ff0-ae5d-006b82819b43 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.404480 Sep 15 07:39:07.600651 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 38/72] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:07 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:07.998851 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-af32df1e-db78-45c7-857c-f024e16baf4b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:07.998851 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-af32df1e-db78-45c7-857c-f024e16baf4b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:08.006396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af32df1e-db78-45c7-857c-f024e16baf4b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:08.006825 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af32df1e-db78-45c7-857c-f024e16baf4b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:08.007286 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af32df1e-db78-45c7-857c-f024e16baf4b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:08.008219 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af32df1e-db78-45c7-857c-f024e16baf4b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:08.008829 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af32df1e-db78-45c7-857c-f024e16baf4b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:08.009402 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af32df1e-db78-45c7-857c-f024e16baf4b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:08.151274 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:08.151938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:08.161030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:08.162039 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:08.162639 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:08.164443 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:08.177248 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:08.177861 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:08.313527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:08.337142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:08.339877 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:08.342438 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-8a4d8ab1-f5bb-43f3-83f1-1f004afa8bb2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1339 microversion: 2.20 time: 0.200786 Sep 15 07:39:08.343769 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 39/73] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:08 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1339 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:39:08.359843 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-af32df1e-db78-45c7-857c-f024e16baf4b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:08.380722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-af32df1e-db78-45c7-857c-f024e16baf4b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1365 microversion: 2.1 time: 0.392407 Sep 15 07:39:08.394518 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 35/74] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:07 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1365 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:08.625206 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-09fde864-5bba-4be6-bd53-2e67606a561c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:08.627527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-09fde864-5bba-4be6-bd53-2e67606a561c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:08.634413 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-09fde864-5bba-4be6-bd53-2e67606a561c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:08.635289 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-09fde864-5bba-4be6-bd53-2e67606a561c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:08.636332 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-09fde864-5bba-4be6-bd53-2e67606a561c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:08.637348 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-09fde864-5bba-4be6-bd53-2e67606a561c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:08.638072 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-09fde864-5bba-4be6-bd53-2e67606a561c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:08.638752 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-09fde864-5bba-4be6-bd53-2e67606a561c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:08.938370 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-09fde864-5bba-4be6-bd53-2e67606a561c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:08.953044 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-09fde864-5bba-4be6-bd53-2e67606a561c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.331839 Sep 15 07:39:08.954532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 40/75] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:08 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:09.369519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:09.371649 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:09.389477 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:09.395852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:09.399848 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:09.399848 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:09.400603 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:09.408295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-02b1c2da-b6b8-449c-bd5c-3502b50f4ca4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:09.408854 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-02b1c2da-b6b8-449c-bd5c-3502b50f4ca4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:09.416649 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:09.417352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:09.424392 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-02b1c2da-b6b8-449c-bd5c-3502b50f4ca4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:09.434276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-02b1c2da-b6b8-449c-bd5c-3502b50f4ca4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:09.434276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-02b1c2da-b6b8-449c-bd5c-3502b50f4ca4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:09.434276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-02b1c2da-b6b8-449c-bd5c-3502b50f4ca4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:09.434276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-02b1c2da-b6b8-449c-bd5c-3502b50f4ca4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:09.434584 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-02b1c2da-b6b8-449c-bd5c-3502b50f4ca4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:09.609417 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=4 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:10.163584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:10.173910 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:10.174096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-02b1c2da-b6b8-449c-bd5c-3502b50f4ca4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:10.175364 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:10.176641 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-64ab1ece-fb67-41f9-9d8a-99b1eb4193bf tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1407 microversion: 2.20 time: 0.812093 Sep 15 07:39:10.177220 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 36/76] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:09 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1407 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:39:10.183039 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3ac13e99-9bcb-4c4c-bc87-ab2f9346108c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:10.183903 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3ac13e99-9bcb-4c4c-bc87-ab2f9346108c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:10.190924 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ac13e99-9bcb-4c4c-bc87-ab2f9346108c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:10.191765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ac13e99-9bcb-4c4c-bc87-ab2f9346108c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:10.192261 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ac13e99-9bcb-4c4c-bc87-ab2f9346108c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:10.193023 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ac13e99-9bcb-4c4c-bc87-ab2f9346108c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:10.193545 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ac13e99-9bcb-4c4c-bc87-ab2f9346108c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:10.194054 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ac13e99-9bcb-4c4c-bc87-ab2f9346108c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:10.202307 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-02b1c2da-b6b8-449c-bd5c-3502b50f4ca4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1365 microversion: 2.1 time: 0.798382 Sep 15 07:39:10.203311 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 41/77] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:09 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1365 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:39:10.546027 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3ac13e99-9bcb-4c4c-bc87-ab2f9346108c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:10.560140 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3ac13e99-9bcb-4c4c-bc87-ab2f9346108c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.381272 Sep 15 07:39:10.561836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 37/78] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:10 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:10.575214 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-67435beb-6735-4a1b-8c88-9ef111e9eeb7 req-cd434472-5b3f-4589-b58f-5af3f19304b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37cd67df-dd0e-4658-9b80-3c29efd65897", "tag": "56775397-b0d1-4018-9f3c-25e559549950"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:10.604375 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-67435beb-6735-4a1b-8c88-9ef111e9eeb7 req-cd434472-5b3f-4589-b58f-5af3f19304b9 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:10.604871 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-67435beb-6735-4a1b-8c88-9ef111e9eeb7 req-cd434472-5b3f-4589-b58f-5af3f19304b9 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:10.605314 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-67435beb-6735-4a1b-8c88-9ef111e9eeb7 req-cd434472-5b3f-4589-b58f-5af3f19304b9 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:10.655700 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-67435beb-6735-4a1b-8c88-9ef111e9eeb7 req-cd434472-5b3f-4589-b58f-5af3f19304b9 service nova] Creating event network-changed:56775397-b0d1-4018-9f3c-25e559549950 for instance 37cd67df-dd0e-4658-9b80-3c29efd65897 on hv-cinder-82414 Sep 15 07:39:10.656246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-67435beb-6735-4a1b-8c88-9ef111e9eeb7 req-cd434472-5b3f-4589-b58f-5af3f19304b9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 15 07:39:10.656776 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-67435beb-6735-4a1b-8c88-9ef111e9eeb7 req-cd434472-5b3f-4589-b58f-5af3f19304b9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 15 07:39:10.661307 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c2c926d-c62a-442e-90f8-61eabff43bd6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:10.665884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c2c926d-c62a-442e-90f8-61eabff43bd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:10.666836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c2c926d-c62a-442e-90f8-61eabff43bd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:10.667777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c2c926d-c62a-442e-90f8-61eabff43bd6 None None] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:10.668250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c2c926d-c62a-442e-90f8-61eabff43bd6 None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:10.668683 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c2c926d-c62a-442e-90f8-61eabff43bd6 None None] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:10.684175 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.compute.rpcapi [None req-3c2c926d-c62a-442e-90f8-61eabff43bd6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 15 07:39:10.685074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c2c926d-c62a-442e-90f8-61eabff43bd6 None None] Releasing lock "compute-rpcapi-router" {{(pid=132673) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 15 07:39:10.704909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3c2c926d-c62a-442e-90f8-61eabff43bd6 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140144 Sep 15 07:39:10.705891 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 38/79] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:39:10.882666 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=8 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:10.974629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3327ce19-dc44-4a89-b9b0-4510115e37f0 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Action: 'create', calling method: .version_select at 0x7ff36cc3c1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-6416058", "metadata": {"Type": "work"}}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3327ce19-dc44-4a89-b9b0-4510115e37f0 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Request method failure captured: Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 119 Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaduJcgJSptcRbPqzQuQG4o25djAXXlI0cVXt94fzjwUhTUUm3fVP0K0d3ybIfwx_uuwmfM0CZbvduqHQl0etGNFOD-0k_LDXGJJEErZB61TSno_Z3eMJzbpRQnNW1eRdNstnPLv1LVc8eNx5vYBssDuvQGeqYvkkxKKu-RW_Ffw2c Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:39:10.980312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bb675a53c68d4776b73e1586e69f4193"}]}] Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 6bc7b045f6da49d5a01c206d00076039 Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-6416058", "metadata": {"Type": "work"}}} Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: Sep 15 07:39:10.981552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-6416058', 'metadata': {'Type': 'work'}}}} Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise error Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi '#$%' Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:39:10.982510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 07:39:11.000390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 07:39:11.002341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 15 07:39:11.002341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.009042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3327ce19-dc44-4a89-b9b0-4510115e37f0 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:39:11.014064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3327ce19-dc44-4a89-b9b0-4510115e37f0 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.808792 Sep 15 07:39:11.014961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 42/80] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 15 07:39:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 811 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 07:39:11.025927 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=24 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:11.032461 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f759901b-b764-4781-8444-1dc8d54827eb tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Action: 'create', calling method: .version_select at 0x7ff36d4e2790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1483192930", "metadata": {"Type": "work"}}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f759901b-b764-4781-8444-1dc8d54827eb tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Request method failure captured: Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 120 Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaduJcgJSptcRbPqzQuQG4o25djAXXlI0cVXt94fzjwUhTUUm3fVP0K0d3ybIfwx_uuwmfM0CZbvduqHQl0etGNFOD-0k_LDXGJJEErZB61TSno_Z3eMJzbpRQnNW1eRdNstnPLv1LVc8eNx5vYBssDuvQGeqYvkkxKKu-RW_Ffw2c Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:39:11.037805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bb675a53c68d4776b73e1586e69f4193"}]}] Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 6bc7b045f6da49d5a01c206d00076039 Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1483192930", "metadata": {"Type": "work"}}} Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: Sep 15 07:39:11.038982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1483192930', 'metadata': {'Type': 'work'}}}} Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise error Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi '0' Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:39:11.039760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 07:39:11.041757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 07:39:11.042927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 15 07:39:11.042927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.042927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f759901b-b764-4781-8444-1dc8d54827eb tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:39:11.042927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f759901b-b764-4781-8444-1dc8d54827eb tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018559 Sep 15 07:39:11.042927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 43/81] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 15 07:39:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 07:39:11.051756 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fa9c0219-9547-4390-b99e-649197d2014a tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Action: 'create', calling method: .version_select at 0x7ff36d4e2dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2093790441", "metadata": {"Type": "work"}}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fa9c0219-9547-4390-b99e-649197d2014a tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Request method failure captured: Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 119 Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaduJcgJSptcRbPqzQuQG4o25djAXXlI0cVXt94fzjwUhTUUm3fVP0K0d3ybIfwx_uuwmfM0CZbvduqHQl0etGNFOD-0k_LDXGJJEErZB61TSno_Z3eMJzbpRQnNW1eRdNstnPLv1LVc8eNx5vYBssDuvQGeqYvkkxKKu-RW_Ffw2c Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:39:11.061133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bb675a53c68d4776b73e1586e69f4193"}]}] Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 6bc7b045f6da49d5a01c206d00076039 Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2093790441", "metadata": {"Type": "work"}}} Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: Sep 15 07:39:11.062278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2093790441', 'metadata': {'Type': 'work'}}}} Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise error Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi '' Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:39:11.063042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 15 07:39:11.064956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 15 07:39:11.066078 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 15 07:39:11.066078 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.067459 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fa9c0219-9547-4390-b99e-649197d2014a tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:39:11.068559 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fa9c0219-9547-4390-b99e-649197d2014a tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021999 Sep 15 07:39:11.069360 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 44/82] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 15 07:39:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 07:39:11.081312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4ae61c1b-55f4-4789-ab70-4ed4d0d3fb9e tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Calling method '.version_select at 0x7ff36d55f430>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:11.111863 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-303a526a-65cb-4ca9-9b21-b93c447b130b req-78165bef-73fa-4ae8-8450-db577d886e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ae2103-9abb-45d7-94b1-7e0f83c44fa0", "tag": "60114f49-493e-46b0-a653-b05d4362ebe7"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:11.134580 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-303a526a-65cb-4ca9-9b21-b93c447b130b req-78165bef-73fa-4ae8-8450-db577d886e24 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:11.136321 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-303a526a-65cb-4ca9-9b21-b93c447b130b req-78165bef-73fa-4ae8-8450-db577d886e24 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:11.140134 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-303a526a-65cb-4ca9-9b21-b93c447b130b req-78165bef-73fa-4ae8-8450-db577d886e24 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:11.147284 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-4ae61c1b-55f4-4789-ab70-4ed4d0d3fb9e tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] HTTP exception thrown: Volume tempest-invalid-1820490659 could not be found. Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4ae61c1b-55f4-4789-ab70-4ed4d0d3fb9e tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Request method failure captured: Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1820490659 HTTP/1.1 Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaduJcgJSptcRbPqzQuQG4o25djAXXlI0cVXt94fzjwUhTUUm3fVP0K0d3ybIfwx_uuwmfM0CZbvduqHQl0etGNFOD-0k_LDXGJJEErZB61TSno_Z3eMJzbpRQnNW1eRdNstnPLv1LVc8eNx5vYBssDuvQGeqYvkkxKKu-RW_Ffw2c Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:39:11.150482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bb675a53c68d4776b73e1586e69f4193"}]}] Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 6bc7b045f6da49d5a01c206d00076039 Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Volume tempest-invalid-1820490659 could not be found. Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': 'tempest-invalid-1820490659'} Sep 15 07:39:11.151917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1820490659 could not be found. (HTTP 404) (Request-ID: req-6884ee1d-0359-47bf-bb56-c0b4c3315cfa) Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.152729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 07:39:11.154023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1820490659 could not be found. Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:39:11.155233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1820490659 could not be found. Sep 15 07:39:11.156646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.156646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.156646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.156646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.156646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:11.156646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:11.156646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:39:11.156646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:39:11.156646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1820490659 could not be found. Sep 15 07:39:11.156646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.158198 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4ae61c1b-55f4-4789-ab70-4ed4d0d3fb9e tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Returning 404 to user: Volume tempest-invalid-1820490659 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:39:11.159270 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4ae61c1b-55f4-4789-ab70-4ed4d0d3fb9e tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1820490659" status: 404 len: 99 microversion: 2.1 time: 0.082814 Sep 15 07:39:11.160356 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 45/83] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Sep 15 07:39:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1820490659 => generated 99 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 15 07:39:11.170370 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e26adf35-4ddd-4b39-b305-2bb61bf2220d tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003793 Sep 15 07:39:11.171882 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 46/84] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Sep 15 07:39:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 07:39:11.183090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-303a526a-65cb-4ca9-9b21-b93c447b130b req-78165bef-73fa-4ae8-8450-db577d886e24 service nova] Creating event network-changed:60114f49-493e-46b0-a653-b05d4362ebe7 for instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 on hv-cinder-82414 Sep 15 07:39:11.188426 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-303a526a-65cb-4ca9-9b21-b93c447b130b req-78165bef-73fa-4ae8-8450-db577d886e24 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248447 Sep 15 07:39:11.189345 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 39/85] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:39:11.190113 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-201152ee-b7d0-4875-a28c-1768826ff78f tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011200 Sep 15 07:39:11.197739 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 47/86] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Sep 15 07:39:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 07:39:11.208472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8198935b-0787-41b2-9739-69d8fc6e9253 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Calling method '.version_select at 0x7ff36cd1e9d0>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:11.216002 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:11.216815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:11.225534 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:11.226918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:11.227458 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:11.228452 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:11.229048 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:11.229903 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:11.251766 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-8198935b-0787-41b2-9739-69d8fc6e9253 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] HTTP exception thrown: Volume 1f16bcd1-5106-43a5-89d5-ee3cc30f74e5 could not be found. Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8198935b-0787-41b2-9739-69d8fc6e9253 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Request method failure captured: Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: DELETE /compute/v2.1/os-volumes/1f16bcd1-5106-43a5-89d5-ee3cc30f74e5 HTTP/1.1 Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaduJcgJSptcRbPqzQuQG4o25djAXXlI0cVXt94fzjwUhTUUm3fVP0K0d3ybIfwx_uuwmfM0CZbvduqHQl0etGNFOD-0k_LDXGJJEErZB61TSno_Z3eMJzbpRQnNW1eRdNstnPLv1LVc8eNx5vYBssDuvQGeqYvkkxKKu-RW_Ffw2c Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:39:11.254941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bb675a53c68d4776b73e1586e69f4193"}]}] Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 6bc7b045f6da49d5a01c206d00076039 Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Volume 1f16bcd1-5106-43a5-89d5-ee3cc30f74e5 could not be found. Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '1f16bcd1-5106-43a5-89d5-ee3cc30f74e5'} Sep 15 07:39:11.265086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f16bcd1-5106-43a5-89d5-ee3cc30f74e5 could not be found. (HTTP 404) (Request-ID: req-cd194610-0cbd-4533-a89d-83baa7710888) Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.265919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 15 07:39:11.267045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f16bcd1-5106-43a5-89d5-ee3cc30f74e5 could not be found. Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 15 07:39:11.268090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f16bcd1-5106-43a5-89d5-ee3cc30f74e5 could not be found. Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f16bcd1-5106-43a5-89d5-ee3cc30f74e5 could not be found. Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8198935b-0787-41b2-9739-69d8fc6e9253 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Returning 404 to user: Volume 1f16bcd1-5106-43a5-89d5-ee3cc30f74e5 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8198935b-0787-41b2-9739-69d8fc6e9253 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/1f16bcd1-5106-43a5-89d5-ee3cc30f74e5" status: 404 len: 109 microversion: 2.1 time: 0.057782 Sep 15 07:39:11.269534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 40/87] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 15 07:39:11 2022] DELETE /compute/v2.1/os-volumes/1f16bcd1-5106-43a5-89d5-ee3cc30f74e5 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:39:11.276325 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-63f421af-b1c5-40e6-a827-101ec1c1b7b2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:11.277311 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-63f421af-b1c5-40e6-a827-101ec1c1b7b2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:11.286431 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-63f421af-b1c5-40e6-a827-101ec1c1b7b2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:11.287176 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-63f421af-b1c5-40e6-a827-101ec1c1b7b2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:11.287791 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-63f421af-b1c5-40e6-a827-101ec1c1b7b2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:11.289166 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-63f421af-b1c5-40e6-a827-101ec1c1b7b2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:11.289870 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-63f421af-b1c5-40e6-a827-101ec1c1b7b2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:11.290452 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-63f421af-b1c5-40e6-a827-101ec1c1b7b2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:11.503850 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:11.507136 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-63f421af-b1c5-40e6-a827-101ec1c1b7b2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:11.511850 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=100 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:11.517043 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:11.518419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-63f421af-b1c5-40e6-a827-101ec1c1b7b2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1365 microversion: 2.1 time: 0.255103 Sep 15 07:39:11.519001 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 41/88] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:11 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:11.519751 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:11.521504 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-79e4a5cf-075e-4aea-a2c3-7ffe3f06924a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1407 microversion: 2.20 time: 0.313445 Sep 15 07:39:11.522509 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 48/89] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:11 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:39:11.524955 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6cc8f83a-db6a-420a-a412-69929d3dad08 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Calling method '.version_select at 0x7ff36cce9ee0>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:11.559825 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-6cc8f83a-db6a-420a-a412-69929d3dad08 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] HTTP exception thrown: Volume ed0d7b47-897e-4ae7-9adf-1cb5de9a7900 could not be found. Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6cc8f83a-db6a-420a-a412-69929d3dad08 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Request method failure captured: Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/os-volumes/ed0d7b47-897e-4ae7-9adf-1cb5de9a7900 HTTP/1.1 Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaduJcgJSptcRbPqzQuQG4o25djAXXlI0cVXt94fzjwUhTUUm3fVP0K0d3ybIfwx_uuwmfM0CZbvduqHQl0etGNFOD-0k_LDXGJJEErZB61TSno_Z3eMJzbpRQnNW1eRdNstnPLv1LVc8eNx5vYBssDuvQGeqYvkkxKKu-RW_Ffw2c Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:39:11.561999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bb675a53c68d4776b73e1586e69f4193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bb675a53c68d4776b73e1586e69f4193"}]}] Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: bb675a53c68d4776b73e1586e69f4193 Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-VolumesNegativeTest-271656861 Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 6bc7b045f6da49d5a01c206d00076039 Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-VolumesNegativeTest-271656861-project Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Volume ed0d7b47-897e-4ae7-9adf-1cb5de9a7900 could not be found. Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': 'ed0d7b47-897e-4ae7-9adf-1cb5de9a7900'} Sep 15 07:39:11.563422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed0d7b47-897e-4ae7-9adf-1cb5de9a7900 could not be found. (HTTP 404) (Request-ID: req-9ffb1df3-fe57-4b24-89fa-830c029f5654) Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.564228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 15 07:39:11.579188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed0d7b47-897e-4ae7-9adf-1cb5de9a7900 could not be found. Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 15 07:39:11.580250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed0d7b47-897e-4ae7-9adf-1cb5de9a7900 could not be found. Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed0d7b47-897e-4ae7-9adf-1cb5de9a7900 could not be found. Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6cc8f83a-db6a-420a-a412-69929d3dad08 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] Returning 404 to user: Volume ed0d7b47-897e-4ae7-9adf-1cb5de9a7900 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6cc8f83a-db6a-420a-a412-69929d3dad08 tempest-VolumesNegativeTest-271656861 tempest-VolumesNegativeTest-271656861-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ed0d7b47-897e-4ae7-9adf-1cb5de9a7900" status: 404 len: 109 microversion: 2.1 time: 0.043698 Sep 15 07:39:11.581516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 42/90] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 15 07:39:11 2022] GET /compute/v2.1/os-volumes/ed0d7b47-897e-4ae7-9adf-1cb5de9a7900 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:39:11.584843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ae5c770a-c31e-481b-8dfa-fbbff391ee3a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:11.585462 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ae5c770a-c31e-481b-8dfa-fbbff391ee3a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:11.592147 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae5c770a-c31e-481b-8dfa-fbbff391ee3a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:11.592642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae5c770a-c31e-481b-8dfa-fbbff391ee3a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:11.593080 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae5c770a-c31e-481b-8dfa-fbbff391ee3a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:11.593812 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae5c770a-c31e-481b-8dfa-fbbff391ee3a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:11.594273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae5c770a-c31e-481b-8dfa-fbbff391ee3a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:11.594704 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae5c770a-c31e-481b-8dfa-fbbff391ee3a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:11.616362 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:11.746579 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ae5c770a-c31e-481b-8dfa-fbbff391ee3a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:11.751814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ae5c770a-c31e-481b-8dfa-fbbff391ee3a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.170992 Sep 15 07:39:11.752381 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 49/91] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:11 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:12.291640 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-28fbe8de-848e-407b-86c7-48d2fca1d896 req-f638d2ed-a5a7-4c04-8dbd-73e1c59db3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0773d518-3cec-4a0a-87bf-eaa60c59154a", "name": "network-vif-plugged", "status": "completed", "tag": "a20fa119-e6e4-4748-9c88-82d94ae223c7"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:12.312320 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:12.329362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-28fbe8de-848e-407b-86c7-48d2fca1d896 req-f638d2ed-a5a7-4c04-8dbd-73e1c59db3dc service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:12.330068 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-28fbe8de-848e-407b-86c7-48d2fca1d896 req-f638d2ed-a5a7-4c04-8dbd-73e1c59db3dc service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:12.330580 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-28fbe8de-848e-407b-86c7-48d2fca1d896 req-f638d2ed-a5a7-4c04-8dbd-73e1c59db3dc service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:12.342559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-28fbe8de-848e-407b-86c7-48d2fca1d896 req-f638d2ed-a5a7-4c04-8dbd-73e1c59db3dc service nova] Creating event network-vif-plugged:a20fa119-e6e4-4748-9c88-82d94ae223c7 for instance 0773d518-3cec-4a0a-87bf-eaa60c59154a on hv-cinder-82414 Sep 15 07:39:12.348179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-28fbe8de-848e-407b-86c7-48d2fca1d896 req-f638d2ed-a5a7-4c04-8dbd-73e1c59db3dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.456734 Sep 15 07:39:12.348781 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 43/92] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:39:12.542077 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5e1fb51c-3307-45c9-ab8a-46c4e0db69da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:12.543969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5e1fb51c-3307-45c9-ab8a-46c4e0db69da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:12.546255 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:12.555637 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e1fb51c-3307-45c9-ab8a-46c4e0db69da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:12.557344 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e1fb51c-3307-45c9-ab8a-46c4e0db69da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:12.558632 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e1fb51c-3307-45c9-ab8a-46c4e0db69da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:12.559923 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e1fb51c-3307-45c9-ab8a-46c4e0db69da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:12.560920 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e1fb51c-3307-45c9-ab8a-46c4e0db69da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:12.569557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e1fb51c-3307-45c9-ab8a-46c4e0db69da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:12.569731 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:12.581193 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:12.591141 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:12.602208 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:12.602208 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:12.602208 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:12.602208 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:12.602976 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:12.835083 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5e1fb51c-3307-45c9-ab8a-46c4e0db69da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:12.846920 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5e1fb51c-3307-45c9-ab8a-46c4e0db69da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1365 microversion: 2.1 time: 0.308687 Sep 15 07:39:12.851294 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 50/93] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:12 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:12.859031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-061c2202-48c8-4709-a9ac-aec5638dec99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:12.860899 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-061c2202-48c8-4709-a9ac-aec5638dec99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:12.877544 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-061c2202-48c8-4709-a9ac-aec5638dec99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:12.879675 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-061c2202-48c8-4709-a9ac-aec5638dec99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:12.880390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-061c2202-48c8-4709-a9ac-aec5638dec99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:12.882004 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-061c2202-48c8-4709-a9ac-aec5638dec99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:12.883349 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-061c2202-48c8-4709-a9ac-aec5638dec99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:12.885300 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-061c2202-48c8-4709-a9ac-aec5638dec99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:12.935701 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:12.971200 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:12.973033 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:12.975081 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f1700bb3-0c3d-4258-bbb4-6775e91447e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1407 microversion: 2.20 time: 0.423510 Sep 15 07:39:12.976177 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 44/94] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:12 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1407 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:39:13.187933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-061c2202-48c8-4709-a9ac-aec5638dec99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:13.205703 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-061c2202-48c8-4709-a9ac-aec5638dec99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.352296 Sep 15 07:39:13.206624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 51/95] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:12 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:13.877340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3c1f0015-1f81-4550-ad17-3992e207eff4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:13.877989 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3c1f0015-1f81-4550-ad17-3992e207eff4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:13.885322 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c1f0015-1f81-4550-ad17-3992e207eff4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:13.885834 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c1f0015-1f81-4550-ad17-3992e207eff4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:13.886274 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c1f0015-1f81-4550-ad17-3992e207eff4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:13.887035 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c1f0015-1f81-4550-ad17-3992e207eff4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:13.887570 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c1f0015-1f81-4550-ad17-3992e207eff4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:13.887996 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3c1f0015-1f81-4550-ad17-3992e207eff4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:14.005291 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:14.005956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:14.013711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:14.014263 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:14.015144 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:14.016012 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:14.016661 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:14.017255 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:14.103706 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3c1f0015-1f81-4550-ad17-3992e207eff4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:14.112798 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3c1f0015-1f81-4550-ad17-3992e207eff4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1365 microversion: 2.1 time: 0.239249 Sep 15 07:39:14.113733 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 45/96] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:13 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:14.177350 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:14.190326 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:14.196712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:14.196712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c795e189-f42d-4b03-ad90-1861c3ec32d4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1407 microversion: 2.20 time: 0.192869 Sep 15 07:39:14.196712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 52/97] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:13 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:39:14.228644 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0ac7b09f-2826-4f8c-95a7-ab70a85f2521 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:14.229244 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0ac7b09f-2826-4f8c-95a7-ab70a85f2521 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:14.236130 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ac7b09f-2826-4f8c-95a7-ab70a85f2521 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:14.237873 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ac7b09f-2826-4f8c-95a7-ab70a85f2521 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:14.237873 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ac7b09f-2826-4f8c-95a7-ab70a85f2521 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:14.238055 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ac7b09f-2826-4f8c-95a7-ab70a85f2521 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:14.238545 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ac7b09f-2826-4f8c-95a7-ab70a85f2521 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:14.239119 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ac7b09f-2826-4f8c-95a7-ab70a85f2521 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:14.371783 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0ac7b09f-2826-4f8c-95a7-ab70a85f2521 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:14.379488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0ac7b09f-2826-4f8c-95a7-ab70a85f2521 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.155118 Sep 15 07:39:14.380057 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 46/98] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:14 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:15.142812 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b318a1d4-2b81-4b4c-89eb-136c313d7452 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:15.143402 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b318a1d4-2b81-4b4c-89eb-136c313d7452 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:15.150338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b318a1d4-2b81-4b4c-89eb-136c313d7452 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:15.150830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b318a1d4-2b81-4b4c-89eb-136c313d7452 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:15.156625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b318a1d4-2b81-4b4c-89eb-136c313d7452 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:15.156625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b318a1d4-2b81-4b4c-89eb-136c313d7452 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:15.156625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b318a1d4-2b81-4b4c-89eb-136c313d7452 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:15.156625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b318a1d4-2b81-4b4c-89eb-136c313d7452 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:15.220482 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:15.220990 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:15.227799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:15.228280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:15.228710 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:15.229435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:15.229907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:15.230330 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:15.317629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b318a1d4-2b81-4b4c-89eb-136c313d7452 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:15.326620 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b318a1d4-2b81-4b4c-89eb-136c313d7452 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1365 microversion: 2.1 time: 0.187693 Sep 15 07:39:15.327049 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 53/99] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:15 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:15.384568 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:15.391908 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:15.393362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:15.394486 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a09d4069-430b-496a-a21f-6a80ec4d92f5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1407 microversion: 2.20 time: 0.178118 Sep 15 07:39:15.396230 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 47/100] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:15 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:39:15.401689 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1218d95d-f55d-4350-905b-f23fab6d3018 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:15.402316 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1218d95d-f55d-4350-905b-f23fab6d3018 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:15.408222 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1218d95d-f55d-4350-905b-f23fab6d3018 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:15.408842 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1218d95d-f55d-4350-905b-f23fab6d3018 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:15.409138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1218d95d-f55d-4350-905b-f23fab6d3018 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:15.409859 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1218d95d-f55d-4350-905b-f23fab6d3018 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:15.410311 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1218d95d-f55d-4350-905b-f23fab6d3018 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:15.412228 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1218d95d-f55d-4350-905b-f23fab6d3018 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:15.616318 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1218d95d-f55d-4350-905b-f23fab6d3018 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:15.628489 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1218d95d-f55d-4350-905b-f23fab6d3018 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.228749 Sep 15 07:39:15.630514 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 54/101] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:15 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:16.351943 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4053abf2-a8a4-466a-b2ee-221d85cb5e86 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:16.353191 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4053abf2-a8a4-466a-b2ee-221d85cb5e86 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:16.360991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4053abf2-a8a4-466a-b2ee-221d85cb5e86 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:16.361842 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4053abf2-a8a4-466a-b2ee-221d85cb5e86 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:16.362491 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4053abf2-a8a4-466a-b2ee-221d85cb5e86 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:16.363666 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4053abf2-a8a4-466a-b2ee-221d85cb5e86 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:16.364265 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4053abf2-a8a4-466a-b2ee-221d85cb5e86 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:16.364957 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4053abf2-a8a4-466a-b2ee-221d85cb5e86 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:16.421343 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:16.421990 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:16.435057 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:16.435911 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:16.436640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:16.437758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:16.438383 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:16.438946 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:16.681879 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4053abf2-a8a4-466a-b2ee-221d85cb5e86 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:16.702218 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4053abf2-a8a4-466a-b2ee-221d85cb5e86 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1365 microversion: 2.1 time: 0.355735 Sep 15 07:39:16.709815 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 48/102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:16 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:16.723744 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f8b54c9c-ec0e-4067-bea6-051b8b34be57 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:16.725065 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f8b54c9c-ec0e-4067-bea6-051b8b34be57 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:16.730473 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:16.735195 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8b54c9c-ec0e-4067-bea6-051b8b34be57 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:16.738896 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8b54c9c-ec0e-4067-bea6-051b8b34be57 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:16.739357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8b54c9c-ec0e-4067-bea6-051b8b34be57 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:16.740475 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8b54c9c-ec0e-4067-bea6-051b8b34be57 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:16.743973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:16.746366 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8b54c9c-ec0e-4067-bea6-051b8b34be57 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:16.747009 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8b54c9c-ec0e-4067-bea6-051b8b34be57 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:16.749104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:16.751238 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-48dc266e-c010-4a77-8e0e-a771c7d436be tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1407 microversion: 2.20 time: 0.333731 Sep 15 07:39:16.754511 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 55/103] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:16 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:39:17.049359 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f8b54c9c-ec0e-4067-bea6-051b8b34be57 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:17.064994 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f8b54c9c-ec0e-4067-bea6-051b8b34be57 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.349852 Sep 15 07:39:17.067510 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 49/104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:16 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:17.736205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-edb6f5c5-d2a4-4c43-9ce1-eac4b313ad60 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:17.736812 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-edb6f5c5-d2a4-4c43-9ce1-eac4b313ad60 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:17.744419 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-edb6f5c5-d2a4-4c43-9ce1-eac4b313ad60 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:17.744898 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-edb6f5c5-d2a4-4c43-9ce1-eac4b313ad60 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:17.745317 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-edb6f5c5-d2a4-4c43-9ce1-eac4b313ad60 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:17.746021 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-edb6f5c5-d2a4-4c43-9ce1-eac4b313ad60 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:17.746471 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-edb6f5c5-d2a4-4c43-9ce1-eac4b313ad60 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:17.746890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-edb6f5c5-d2a4-4c43-9ce1-eac4b313ad60 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:17.780533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:17.782132 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:17.788793 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:17.789373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:17.790104 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:17.790808 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:17.791271 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:17.791697 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:17.946985 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-edb6f5c5-d2a4-4c43-9ce1-eac4b313ad60 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:17.962822 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-edb6f5c5-d2a4-4c43-9ce1-eac4b313ad60 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1365 microversion: 2.1 time: 0.230636 Sep 15 07:39:17.965733 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 56/105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:17 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:39:17.994254 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:18.003353 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:18.004914 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:18.006088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6b00359a-61eb-491b-bab6-e8c2f497103f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1407 microversion: 2.20 time: 0.229624 Sep 15 07:39:18.006654 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 50/106] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:17 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:39:18.090138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-dbdeddef-c47d-4476-b1d4-522208dc6f17 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:18.090684 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-dbdeddef-c47d-4476-b1d4-522208dc6f17 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:18.107423 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dbdeddef-c47d-4476-b1d4-522208dc6f17 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:18.108090 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dbdeddef-c47d-4476-b1d4-522208dc6f17 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:18.108515 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dbdeddef-c47d-4476-b1d4-522208dc6f17 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:18.109295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dbdeddef-c47d-4476-b1d4-522208dc6f17 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:18.109969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dbdeddef-c47d-4476-b1d4-522208dc6f17 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:18.110450 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dbdeddef-c47d-4476-b1d4-522208dc6f17 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:18.286050 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-e88b1ecb-a0b0-4fdc-89e1-664a4e410e59 req-59ad3bf4-e0e4-4123-af3a-c8b4776a6210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37cd67df-dd0e-4658-9b80-3c29efd65897", "name": "network-vif-plugged", "status": "completed", "tag": "56775397-b0d1-4018-9f3c-25e559549950"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:18.311678 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-e88b1ecb-a0b0-4fdc-89e1-664a4e410e59 req-59ad3bf4-e0e4-4123-af3a-c8b4776a6210 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:18.312082 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-e88b1ecb-a0b0-4fdc-89e1-664a4e410e59 req-59ad3bf4-e0e4-4123-af3a-c8b4776a6210 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:18.312525 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-e88b1ecb-a0b0-4fdc-89e1-664a4e410e59 req-59ad3bf4-e0e4-4123-af3a-c8b4776a6210 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:18.329465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-e88b1ecb-a0b0-4fdc-89e1-664a4e410e59 req-59ad3bf4-e0e4-4123-af3a-c8b4776a6210 service nova] Creating event network-vif-plugged:56775397-b0d1-4018-9f3c-25e559549950 for instance 37cd67df-dd0e-4658-9b80-3c29efd65897 on hv-cinder-82414 Sep 15 07:39:18.332275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-dbdeddef-c47d-4476-b1d4-522208dc6f17 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:18.344679 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-dbdeddef-c47d-4476-b1d4-522208dc6f17 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1315 microversion: 2.1 time: 0.259199 Sep 15 07:39:18.346489 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 57/107] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:18 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:18.350431 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-e88b1ecb-a0b0-4fdc-89e1-664a4e410e59 req-59ad3bf4-e0e4-4123-af3a-c8b4776a6210 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068261 Sep 15 07:39:18.352679 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 51/108] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:39:18.989424 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b33eb672-87e3-4266-80f1-13097125a64c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:18.990249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b33eb672-87e3-4266-80f1-13097125a64c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:18.997933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b33eb672-87e3-4266-80f1-13097125a64c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:18.998506 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b33eb672-87e3-4266-80f1-13097125a64c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:18.999016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b33eb672-87e3-4266-80f1-13097125a64c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:18.999930 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b33eb672-87e3-4266-80f1-13097125a64c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:19.000488 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b33eb672-87e3-4266-80f1-13097125a64c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:19.001002 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b33eb672-87e3-4266-80f1-13097125a64c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:19.031476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:19.032256 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:19.038409 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:19.038977 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:19.040584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:19.041347 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:19.041905 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:19.042400 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:19.207547 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b33eb672-87e3-4266-80f1-13097125a64c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:19.220866 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b33eb672-87e3-4266-80f1-13097125a64c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1365 microversion: 2.1 time: 0.234756 Sep 15 07:39:19.221882 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 58/109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:18 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:19.242307 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:19.250704 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:19.252263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:19.253464 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-fd2e4221-b120-4a51-a74c-fd6047cf5772 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1407 microversion: 2.20 time: 0.226151 Sep 15 07:39:19.254797 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 52/110] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:19 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:39:19.369088 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bea88824-a585-4d50-b837-e51282bd60c6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:19.369442 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bea88824-a585-4d50-b837-e51282bd60c6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:19.376237 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bea88824-a585-4d50-b837-e51282bd60c6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:19.377838 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bea88824-a585-4d50-b837-e51282bd60c6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:19.377838 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bea88824-a585-4d50-b837-e51282bd60c6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:19.378174 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bea88824-a585-4d50-b837-e51282bd60c6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:19.378548 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bea88824-a585-4d50-b837-e51282bd60c6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:19.378869 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bea88824-a585-4d50-b837-e51282bd60c6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:19.522137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bea88824-a585-4d50-b837-e51282bd60c6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:19.531578 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bea88824-a585-4d50-b837-e51282bd60c6 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1502 microversion: 2.1 time: 0.167169 Sep 15 07:39:19.545602 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 59/111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:19 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:20.248572 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9128ab58-4e9f-41a1-bbe3-d329e898ef05 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:20.249334 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-9128ab58-4e9f-41a1-bbe3-d329e898ef05 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:20.255991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9128ab58-4e9f-41a1-bbe3-d329e898ef05 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:20.256560 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9128ab58-4e9f-41a1-bbe3-d329e898ef05 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:20.257075 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9128ab58-4e9f-41a1-bbe3-d329e898ef05 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:20.258815 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9128ab58-4e9f-41a1-bbe3-d329e898ef05 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:20.259434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9128ab58-4e9f-41a1-bbe3-d329e898ef05 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:20.260002 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9128ab58-4e9f-41a1-bbe3-d329e898ef05 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:20.285415 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:20.286129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:20.293149 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:20.293942 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:20.310851 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:20.310851 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:20.310851 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:20.310851 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:20.486063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-9128ab58-4e9f-41a1-bbe3-d329e898ef05 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:20.496617 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9128ab58-4e9f-41a1-bbe3-d329e898ef05 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1365 microversion: 2.1 time: 0.252502 Sep 15 07:39:20.513827 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:20.517296 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 53/112] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:20 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:20.519759 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-784f4243-7bb4-401c-b320-90f4f73b7065 req-0ef41613-2759-40cc-8fe0-3c501b47c317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ae2103-9abb-45d7-94b1-7e0f83c44fa0", "name": "network-vif-plugged", "status": "completed", "tag": "60114f49-493e-46b0-a653-b05d4362ebe7"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:20.527172 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:20.528913 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:20.530915 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-125f2d94-e1f9-4de4-9e03-d0056aec9d05 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1407 microversion: 2.20 time: 0.249794 Sep 15 07:39:20.531026 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-784f4243-7bb4-401c-b320-90f4f73b7065 req-0ef41613-2759-40cc-8fe0-3c501b47c317 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:20.531372 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 60/113] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:20 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:39:20.531744 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-784f4243-7bb4-401c-b320-90f4f73b7065 req-0ef41613-2759-40cc-8fe0-3c501b47c317 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:20.532179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-784f4243-7bb4-401c-b320-90f4f73b7065 req-0ef41613-2759-40cc-8fe0-3c501b47c317 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:20.544953 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-784f4243-7bb4-401c-b320-90f4f73b7065 req-0ef41613-2759-40cc-8fe0-3c501b47c317 service nova] Creating event network-vif-plugged:60114f49-493e-46b0-a653-b05d4362ebe7 for instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 on hv-cinder-82414 Sep 15 07:39:20.550285 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-784f4243-7bb4-401c-b320-90f4f73b7065 req-0ef41613-2759-40cc-8fe0-3c501b47c317 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034568 Sep 15 07:39:20.551182 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 54/114] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:39:21.521454 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4a2b733e-5b1a-4475-97c3-47277e305bb2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:21.522124 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-4a2b733e-5b1a-4475-97c3-47277e305bb2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:21.528352 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4a2b733e-5b1a-4475-97c3-47277e305bb2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:21.528834 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4a2b733e-5b1a-4475-97c3-47277e305bb2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:21.530949 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4a2b733e-5b1a-4475-97c3-47277e305bb2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:21.530949 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4a2b733e-5b1a-4475-97c3-47277e305bb2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:21.530949 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4a2b733e-5b1a-4475-97c3-47277e305bb2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:21.531409 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4a2b733e-5b1a-4475-97c3-47277e305bb2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:21.574652 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:21.580290 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:21.581022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:21.590908 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:21.591397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:21.591825 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:21.592571 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:21.593016 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:21.593433 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:21.740640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4a2b733e-5b1a-4475-97c3-47277e305bb2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:21.749193 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4a2b733e-5b1a-4475-97c3-47277e305bb2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1365 microversion: 2.1 time: 0.231603 Sep 15 07:39:21.750056 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 61/115] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:21 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:21.801989 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:21.811075 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:21.812498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:21.813745 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3456bf0e-5cea-4e62-8bc3-aef462eb7e6e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1407 microversion: 2.20 time: 0.240856 Sep 15 07:39:21.814304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 55/116] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:21 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:39:22.346210 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-265a52f8-61e1-47d0-b21a-d29c93a2c11c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aea3bb3e-e77d-46c2-9e68-4ad326218855"}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:22.348694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-265a52f8-61e1-47d0-b21a-d29c93a2c11c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:22.355134 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-265a52f8-61e1-47d0-b21a-d29c93a2c11c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:22.357178 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-265a52f8-61e1-47d0-b21a-d29c93a2c11c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:22.357681 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-265a52f8-61e1-47d0-b21a-d29c93a2c11c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:22.358434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-265a52f8-61e1-47d0-b21a-d29c93a2c11c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:22.358876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-265a52f8-61e1-47d0-b21a-d29c93a2c11c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:22.359295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-265a52f8-61e1-47d0-b21a-d29c93a2c11c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:22.772821 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c0a40aa0-b6d2-4373-a1cf-a8904467f0a3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:22.773602 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c0a40aa0-b6d2-4373-a1cf-a8904467f0a3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:22.781025 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c0a40aa0-b6d2-4373-a1cf-a8904467f0a3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:22.781531 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c0a40aa0-b6d2-4373-a1cf-a8904467f0a3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:22.781996 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c0a40aa0-b6d2-4373-a1cf-a8904467f0a3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:22.782799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c0a40aa0-b6d2-4373-a1cf-a8904467f0a3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:22.783208 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c0a40aa0-b6d2-4373-a1cf-a8904467f0a3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:22.783638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c0a40aa0-b6d2-4373-a1cf-a8904467f0a3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:23.104944 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c0a40aa0-b6d2-4373-a1cf-a8904467f0a3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:23.113557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c0a40aa0-b6d2-4373-a1cf-a8904467f0a3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1555 microversion: 2.1 time: 0.344816 Sep 15 07:39:23.114232 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 56/117] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:22 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1555 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:39:23.119929 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:23.120531 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:23.126581 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:23.127055 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:23.127489 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:23.128174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:23.128624 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:23.129040 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:23.319287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:23.328266 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:23.329731 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:23.330841 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b29a8450-4f13-49f6-b5cd-e9e787422706 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1407 microversion: 2.20 time: 0.215626 Sep 15 07:39:23.331425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 57/118] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:23 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:39:23.336000 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f3c6fe95-f95a-4f9e-801a-1e4e83ae1bb1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:23.336785 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f3c6fe95-f95a-4f9e-801a-1e4e83ae1bb1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:23.343224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3c6fe95-f95a-4f9e-801a-1e4e83ae1bb1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:23.344010 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3c6fe95-f95a-4f9e-801a-1e4e83ae1bb1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:23.344122 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3c6fe95-f95a-4f9e-801a-1e4e83ae1bb1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:23.344813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3c6fe95-f95a-4f9e-801a-1e4e83ae1bb1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:23.345259 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3c6fe95-f95a-4f9e-801a-1e4e83ae1bb1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:23.345724 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3c6fe95-f95a-4f9e-801a-1e4e83ae1bb1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:23.472951 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f3c6fe95-f95a-4f9e-801a-1e4e83ae1bb1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140321 Sep 15 07:39:23.473765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 58/119] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 15 07:39:23 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:39:24.278329 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-265a52f8-61e1-47d0-b21a-d29c93a2c11c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "POST /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.935793 Sep 15 07:39:24.278971 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 62/120] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:39:22 2022] POST /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a/os-volume_attachments => generated 194 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:39:24.357495 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:24.359057 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:24.368912 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:24.368912 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:24.368912 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:24.370480 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:24.371052 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:24.371699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:24.550484 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:24.562724 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:24.564442 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:24.566260 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-333e13e4-e4ae-4290-937b-83ec8d592870 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1599 microversion: 2.20 time: 0.213212 Sep 15 07:39:24.569381 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 59/121] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:39:24 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:39:24.600955 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3f29dfba-8389-47e6-b574-71f6d02054c4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:24.606405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3f29dfba-8389-47e6-b574-71f6d02054c4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:24.621015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f29dfba-8389-47e6-b574-71f6d02054c4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:24.621508 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f29dfba-8389-47e6-b574-71f6d02054c4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:24.622035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f29dfba-8389-47e6-b574-71f6d02054c4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:24.622745 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f29dfba-8389-47e6-b574-71f6d02054c4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:24.623197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f29dfba-8389-47e6-b574-71f6d02054c4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:24.623655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f29dfba-8389-47e6-b574-71f6d02054c4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:24.714827 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3f29dfba-8389-47e6-b574-71f6d02054c4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.120053 Sep 15 07:39:24.715325 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 63/122] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Sep 15 07:39:24 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:39:25.288327 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-cbc32589-5092-4ee7-ad45-e26ba23b5f3a req-c8c10460-4a39-4eb5-91a2-e08eee01979b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37cd67df-dd0e-4658-9b80-3c29efd65897", "tag": "56775397-b0d1-4018-9f3c-25e559549950"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:25.299069 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-cbc32589-5092-4ee7-ad45-e26ba23b5f3a req-c8c10460-4a39-4eb5-91a2-e08eee01979b service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:25.299705 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-cbc32589-5092-4ee7-ad45-e26ba23b5f3a req-c8c10460-4a39-4eb5-91a2-e08eee01979b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:25.300344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-cbc32589-5092-4ee7-ad45-e26ba23b5f3a req-c8c10460-4a39-4eb5-91a2-e08eee01979b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:25.315613 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-cbc32589-5092-4ee7-ad45-e26ba23b5f3a req-c8c10460-4a39-4eb5-91a2-e08eee01979b service nova] Creating event network-changed:56775397-b0d1-4018-9f3c-25e559549950 for instance 37cd67df-dd0e-4658-9b80-3c29efd65897 on hv-cinder-82414 Sep 15 07:39:25.321653 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-cbc32589-5092-4ee7-ad45-e26ba23b5f3a req-c8c10460-4a39-4eb5-91a2-e08eee01979b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036726 Sep 15 07:39:25.327265 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 60/123] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:39:26.416975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-992dadec-a1e9-40da-a456-2e42b82a5da0 req-222db9d9-783b-475a-89ea-4d53f5521fce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ae2103-9abb-45d7-94b1-7e0f83c44fa0", "tag": "60114f49-493e-46b0-a653-b05d4362ebe7"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:26.435689 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-992dadec-a1e9-40da-a456-2e42b82a5da0 req-222db9d9-783b-475a-89ea-4d53f5521fce service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:26.436411 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-992dadec-a1e9-40da-a456-2e42b82a5da0 req-222db9d9-783b-475a-89ea-4d53f5521fce service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:26.436980 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-992dadec-a1e9-40da-a456-2e42b82a5da0 req-222db9d9-783b-475a-89ea-4d53f5521fce service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:26.450990 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-992dadec-a1e9-40da-a456-2e42b82a5da0 req-222db9d9-783b-475a-89ea-4d53f5521fce service nova] Creating event network-changed:60114f49-493e-46b0-a653-b05d4362ebe7 for instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 on hv-cinder-82414 Sep 15 07:39:26.456762 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-992dadec-a1e9-40da-a456-2e42b82a5da0 req-222db9d9-783b-475a-89ea-4d53f5521fce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045677 Sep 15 07:39:26.457879 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 64/124] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:39:43.697241 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0191587b-6b4b-4718-bc12-a074c2374a7e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:43.697918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0191587b-6b4b-4718-bc12-a074c2374a7e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:43.700786 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=35 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:43.703478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=90 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:43.713214 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0191587b-6b4b-4718-bc12-a074c2374a7e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:43.716425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0191587b-6b4b-4718-bc12-a074c2374a7e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:43.716425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0191587b-6b4b-4718-bc12-a074c2374a7e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:43.716425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0191587b-6b4b-4718-bc12-a074c2374a7e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:43.716425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0191587b-6b4b-4718-bc12-a074c2374a7e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:43.717015 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0191587b-6b4b-4718-bc12-a074c2374a7e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:43.747838 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0191587b-6b4b-4718-bc12-a074c2374a7e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Going to try to terminate instance {{(pid=132673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:39:44.164370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0191587b-6b4b-4718-bc12-a074c2374a7e tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 204 len: 0 microversion: 2.1 time: 0.467806 Sep 15 07:39:44.164370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 61/125] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:39:43 2022] DELETE /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:39:44.167607 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=29 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:44.169351 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:39:44.174025 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a689e1e1-aa90-4a1b-b8d0-98e143afab5c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:44.175148 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a689e1e1-aa90-4a1b-b8d0-98e143afab5c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:44.181682 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a689e1e1-aa90-4a1b-b8d0-98e143afab5c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:44.182257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a689e1e1-aa90-4a1b-b8d0-98e143afab5c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:44.182964 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a689e1e1-aa90-4a1b-b8d0-98e143afab5c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:44.183800 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a689e1e1-aa90-4a1b-b8d0-98e143afab5c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:44.184673 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a689e1e1-aa90-4a1b-b8d0-98e143afab5c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:44.185383 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a689e1e1-aa90-4a1b-b8d0-98e143afab5c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:44.330912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a689e1e1-aa90-4a1b-b8d0-98e143afab5c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:44.340242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a689e1e1-aa90-4a1b-b8d0-98e143afab5c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1554 microversion: 2.1 time: 0.174601 Sep 15 07:39:44.340840 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 65/126] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:44 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:45.364008 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0418c133-7846-43a4-99ce-2504194a5a31 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:45.364716 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0418c133-7846-43a4-99ce-2504194a5a31 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:45.371932 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0418c133-7846-43a4-99ce-2504194a5a31 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:45.372407 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0418c133-7846-43a4-99ce-2504194a5a31 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:45.372806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0418c133-7846-43a4-99ce-2504194a5a31 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:45.376675 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0418c133-7846-43a4-99ce-2504194a5a31 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:45.376675 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0418c133-7846-43a4-99ce-2504194a5a31 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:45.376675 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0418c133-7846-43a4-99ce-2504194a5a31 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:45.566936 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0418c133-7846-43a4-99ce-2504194a5a31 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:45.575569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0418c133-7846-43a4-99ce-2504194a5a31 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1554 microversion: 2.1 time: 0.215914 Sep 15 07:39:45.576150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 62/127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:45 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:46.598874 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3bf955f1-9b57-45f7-9a2d-7e5d08a86ace tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:46.600131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3bf955f1-9b57-45f7-9a2d-7e5d08a86ace tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:46.608681 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3bf955f1-9b57-45f7-9a2d-7e5d08a86ace tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:46.609305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3bf955f1-9b57-45f7-9a2d-7e5d08a86ace tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:46.609872 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3bf955f1-9b57-45f7-9a2d-7e5d08a86ace tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:46.610800 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3bf955f1-9b57-45f7-9a2d-7e5d08a86ace tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:46.611418 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3bf955f1-9b57-45f7-9a2d-7e5d08a86ace tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:46.611840 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3bf955f1-9b57-45f7-9a2d-7e5d08a86ace tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:46.751900 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3bf955f1-9b57-45f7-9a2d-7e5d08a86ace tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:46.760352 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3bf955f1-9b57-45f7-9a2d-7e5d08a86ace tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1554 microversion: 2.1 time: 0.165335 Sep 15 07:39:46.760992 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 66/128] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:46 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:47.784392 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-dd307b95-7469-4479-aa21-999d74b94942 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:47.787950 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-dd307b95-7469-4479-aa21-999d74b94942 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:47.791893 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd307b95-7469-4479-aa21-999d74b94942 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:47.792388 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd307b95-7469-4479-aa21-999d74b94942 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:47.792826 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd307b95-7469-4479-aa21-999d74b94942 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:47.793527 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd307b95-7469-4479-aa21-999d74b94942 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:47.794019 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd307b95-7469-4479-aa21-999d74b94942 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:47.794451 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd307b95-7469-4479-aa21-999d74b94942 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:47.949861 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-dd307b95-7469-4479-aa21-999d74b94942 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:47.959809 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-dd307b95-7469-4479-aa21-999d74b94942 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1554 microversion: 2.1 time: 0.179217 Sep 15 07:39:47.961838 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 63/129] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:47 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:48.984033 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0d4d400b-b869-4438-8d1a-cb2ddf88fe9c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:48.987260 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0d4d400b-b869-4438-8d1a-cb2ddf88fe9c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:48.991116 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d4d400b-b869-4438-8d1a-cb2ddf88fe9c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:48.991865 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d4d400b-b869-4438-8d1a-cb2ddf88fe9c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:48.992396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d4d400b-b869-4438-8d1a-cb2ddf88fe9c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:48.993165 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d4d400b-b869-4438-8d1a-cb2ddf88fe9c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:48.993725 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d4d400b-b869-4438-8d1a-cb2ddf88fe9c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:48.994715 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d4d400b-b869-4438-8d1a-cb2ddf88fe9c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:49.098624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0d4d400b-b869-4438-8d1a-cb2ddf88fe9c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:49.117312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0d4d400b-b869-4438-8d1a-cb2ddf88fe9c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1512 microversion: 2.1 time: 0.132824 Sep 15 07:39:49.117312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 67/130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:48 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1512 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:49.187820 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-73edd681-ce9f-42df-963d-7aca0d5ec587 req-649b48c0-beb3-46db-b35e-75d24516201b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0773d518-3cec-4a0a-87bf-eaa60c59154a", "name": "network-vif-deleted", "tag": "a20fa119-e6e4-4748-9c88-82d94ae223c7"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:39:49.205191 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-73edd681-ce9f-42df-963d-7aca0d5ec587 req-649b48c0-beb3-46db-b35e-75d24516201b service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:49.209902 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-73edd681-ce9f-42df-963d-7aca0d5ec587 req-649b48c0-beb3-46db-b35e-75d24516201b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:49.209902 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-73edd681-ce9f-42df-963d-7aca0d5ec587 req-649b48c0-beb3-46db-b35e-75d24516201b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:49.221418 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-73edd681-ce9f-42df-963d-7aca0d5ec587 req-649b48c0-beb3-46db-b35e-75d24516201b service nova] Creating event network-vif-deleted:a20fa119-e6e4-4748-9c88-82d94ae223c7 for instance 0773d518-3cec-4a0a-87bf-eaa60c59154a on hv-cinder-82414 Sep 15 07:39:49.227424 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-73edd681-ce9f-42df-963d-7aca0d5ec587 req-649b48c0-beb3-46db-b35e-75d24516201b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043496 Sep 15 07:39:49.229115 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 64/131] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:39:50.140269 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:50.140875 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:50.147638 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:50.148125 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:50.148562 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:50.149257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:50.149746 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:50.150170 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:50.196543 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:50.196635 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:50.197060 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:50.198102 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lazy-loading 'fault' on Instance uuid 0773d518-3cec-4a0a-87bf-eaa60c59154a {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:39:50.254371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d51e6d2afe1436e8a65b895c83bdd38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9836d4c25e0e46a8a6245bb7b74c55ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:39:50.263902 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9bd50300-b0a0-4b24-9610-a3b6504e5695 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 200 len: 1351 microversion: 2.1 time: 0.127457 Sep 15 07:39:50.264477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 68/132] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:50 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 1351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:39:51.293598 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:51.294616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:51.301114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:51.302158 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:51.305097 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:51.307415 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:51.307415 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:51.307613 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:51.321378 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] HTTP exception thrown: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Request method failure captured: Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a HTTP/1.1 Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaBj0fSgPoXFIv5Vg_MrFlqwdTrPBu1QQOAse2rTgp6ZUsES9XZYMj7gzK4XzSjz-qE_qxSDOlStKcniG5T9Bu4TXtM5xUe8O85P8vDLP1ySD7opUqWWMfdji7omDEUhK9qQIu9WwKyxOGRNIVk0yCV_A7XDm_srblDO5DC4RW3ZTU Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 9836d4c25e0e46a8a6245bb7b74c55ce Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:39:51.326992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9836d4c25e0e46a8a6245bb7b74c55ce"}]}] Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 9836d4c25e0e46a8a6245bb7b74c55ce Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-DeleteServersTestJSON-1720729274-project Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 1d51e6d2afe1436e8a65b895c83bdd38 Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-DeleteServersTestJSON-1720729274-project Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:51.331434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '0773d518-3cec-4a0a-87bf-eaa60c59154a'} Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:39:51.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:51.334124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:51.335188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Returning 404 to user: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:39:51.335188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-44b7d30c-6e8e-444d-b2da-80c44d19ac3c tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 404 len: 111 microversion: 2.1 time: 0.039341 Sep 15 07:39:51.335188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 65/133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:51 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:39:51.442734 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:51.444975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:51.452219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:51.452696 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:51.453127 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:51.453841 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:51.454291 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:51.454712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:51.467832 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] HTTP exception thrown: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Request method failure captured: Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a/os-volume_attachments HTTP/1.1 Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaBj0fSgPoXFIv5Vg_MrFlqwdTrPBu1QQOAse2rTgp6ZUsES9XZYMj7gzK4XzSjz-qE_qxSDOlStKcniG5T9Bu4TXtM5xUe8O85P8vDLP1ySD7opUqWWMfdji7omDEUhK9qQIu9WwKyxOGRNIVk0yCV_A7XDm_srblDO5DC4RW3ZTU Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: 9836d4c25e0e46a8a6245bb7b74c55ce Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:39:51.472131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9836d4c25e0e46a8a6245bb7b74c55ce"}]}] Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: 9836d4c25e0e46a8a6245bb7b74c55ce Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-DeleteServersTestJSON-1720729274-project Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 1d51e6d2afe1436e8a65b895c83bdd38 Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-DeleteServersTestJSON-1720729274-project Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:51.473338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'server_id': '0773d518-3cec-4a0a-87bf-eaa60c59154a'} Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:39:51.474006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:51.475770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:51.476824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Returning 404 to user: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:39:51.476824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-acb2cdaf-8582-4998-baec-8585730ba48a tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034791 Sep 15 07:39:51.476824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 69/134] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:39:51 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:39:55.965301 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:55.966091 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:55.972461 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:55.973009 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:55.973441 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:55.974198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:55.974816 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:55.975238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:55.992090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] HTTP exception thrown: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Request method failure captured: Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: DELETE /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a HTTP/1.1 Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaBj0fSgPoXFIv5Vg_MrFlqwdTrPBu1QQOAse2rTgp6ZUsES9XZYMj7gzK4XzSjz-qE_qxSDOlStKcniG5T9Bu4TXtM5xUe8O85P8vDLP1ySD7opUqWWMfdji7omDEUhK9qQIu9WwKyxOGRNIVk0yCV_A7XDm_srblDO5DC4RW3ZTU Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 9836d4c25e0e46a8a6245bb7b74c55ce Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:39:55.993852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9836d4c25e0e46a8a6245bb7b74c55ce"}]}] Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 9836d4c25e0e46a8a6245bb7b74c55ce Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-DeleteServersTestJSON-1720729274-project Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 1d51e6d2afe1436e8a65b895c83bdd38 Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-DeleteServersTestJSON-1720729274-project Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:55.995698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '0773d518-3cec-4a0a-87bf-eaa60c59154a'} Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:39:55.996529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:55.997540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:39:56.003628 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Returning 404 to user: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:39:56.003628 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5bdd74b6-54bf-41b6-9340-7fa0dee2ae99 tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 404 len: 111 microversion: 2.1 time: 0.035089 Sep 15 07:39:56.003628 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 66/135] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:39:55 2022] DELETE /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:39:56.006458 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:39:56.007110 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] [instance: 0773d518-3cec-4a0a-87bf-eaa60c59154a] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:39:56.014130 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:56.014737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:56.015051 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:56.015734 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:39:56.016181 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:39:56.016602 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:39:56.031666 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] HTTP exception thrown: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Request method failure captured: Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a HTTP/1.1 Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaBj0fSgPoXFIv5Vg_MrFlqwdTrPBu1QQOAse2rTgp6ZUsES9XZYMj7gzK4XzSjz-qE_qxSDOlStKcniG5T9Bu4TXtM5xUe8O85P8vDLP1ySD7opUqWWMfdji7omDEUhK9qQIu9WwKyxOGRNIVk0yCV_A7XDm_srblDO5DC4RW3ZTU Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: 9836d4c25e0e46a8a6245bb7b74c55ce Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:39:56.033807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9836d4c25e0e46a8a6245bb7b74c55ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9836d4c25e0e46a8a6245bb7b74c55ce"}]}] Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: 9836d4c25e0e46a8a6245bb7b74c55ce Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720729274 Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-DeleteServersTestJSON-1720729274-project Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 1d51e6d2afe1436e8a65b895c83bdd38 Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-DeleteServersTestJSON-1720729274-project Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:56.035129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '0773d518-3cec-4a0a-87bf-eaa60c59154a'} Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:39:56.035998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. Sep 15 07:39:56.037154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:39:56.038347 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] Returning 404 to user: Instance 0773d518-3cec-4a0a-87bf-eaa60c59154a could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:39:56.038347 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bce24103-8c60-482e-af38-0005575d711f tempest-DeleteServersTestJSON-1720729274 tempest-DeleteServersTestJSON-1720729274-project] 10.222.0.42 "GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a" status: 404 len: 111 microversion: 2.1 time: 0.032935 Sep 15 07:39:56.038347 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 70/136] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:39:56 2022] GET /compute/v2.1/servers/0773d518-3cec-4a0a-87bf-eaa60c59154a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:40:08.585232 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:08.586561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:08.705397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-172938698", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:08.762955 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] validate_networks() for [('9125b9da-cf0a-438e-a321-05e9db8df553', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:40:09.145557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:40:09.146067 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:40:09.146635 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:40:09.147144 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:40:09.147777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:40:09.158004 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:09.158482 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:09.162064 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:09.162064 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:09.162064 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:09.162064 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:09.178019 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Getting quotas for project cdc69db806d24d1f8eb18aadaaafabcb. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:40:09.182051 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Getting quotas for user 21de3a85b2df4af2833a24ab02f477c8 and project cdc69db806d24d1f8eb18aadaaafabcb. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:40:09.194485 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:40:09.196831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:40:09.316874 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2ab7557e-1ebe-453e-91a7-ebe5c610e47f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.736418 Sep 15 07:40:09.317855 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 67/137] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:40:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:40:09.330185 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1cbbb6ca-cc8a-4955-8b7b-441341230207 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:09.331495 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1cbbb6ca-cc8a-4955-8b7b-441341230207 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:09.340068 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=14 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:09.341861 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=30 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:09.398313 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1cbbb6ca-cc8a-4955-8b7b-441341230207 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:09.409808 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1cbbb6ca-cc8a-4955-8b7b-441341230207 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1221 microversion: 2.1 time: 0.084641 Sep 15 07:40:09.410525 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 71/138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:09 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:09.490709 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-301217663", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:09.557544 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] validate_networks() for [('9125b9da-cf0a-438e-a321-05e9db8df553', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:40:10.026815 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:40:10.028596 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:40:10.029186 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:40:10.029689 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:40:10.030174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:40:10.048986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:10.048986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:10.048986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:10.048986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:10.049281 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:10.049281 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:10.117847 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Getting quotas for project cdc69db806d24d1f8eb18aadaaafabcb. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:40:10.128927 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Getting quotas for user 21de3a85b2df4af2833a24ab02f477c8 and project cdc69db806d24d1f8eb18aadaaafabcb. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:40:10.148950 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:40:10.151205 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:40:10.341836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-48d636ec-e85c-493b-8518-5d22f850147f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.855538 Sep 15 07:40:10.343063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 68/139] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:40:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:40:10.354445 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b85048ba-c4e0-4822-89dd-be3803df21ec tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:10.356191 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b85048ba-c4e0-4822-89dd-be3803df21ec tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:10.425956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b85048ba-c4e0-4822-89dd-be3803df21ec tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:10.439058 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b85048ba-c4e0-4822-89dd-be3803df21ec tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1221 microversion: 2.1 time: 0.088958 Sep 15 07:40:10.445958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 72/140] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:10 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:11.462845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-13e19201-550f-4190-b3d7-707496812e86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:11.464086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-13e19201-550f-4190-b3d7-707496812e86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:11.540498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-13e19201-550f-4190-b3d7-707496812e86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:11.548329 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-13e19201-550f-4190-b3d7-707496812e86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1221 microversion: 2.1 time: 0.089436 Sep 15 07:40:11.549458 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 69/141] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:11 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:12.573822 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5fd86139-2b32-4d40-bf02-667af96d2553 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:12.574912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5fd86139-2b32-4d40-bf02-667af96d2553 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:12.583972 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd86139-2b32-4d40-bf02-667af96d2553 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:12.584453 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd86139-2b32-4d40-bf02-667af96d2553 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:12.584880 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd86139-2b32-4d40-bf02-667af96d2553 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:12.585561 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd86139-2b32-4d40-bf02-667af96d2553 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:12.586032 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd86139-2b32-4d40-bf02-667af96d2553 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:12.586448 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd86139-2b32-4d40-bf02-667af96d2553 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:12.649909 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5fd86139-2b32-4d40-bf02-667af96d2553 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:12.660606 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5fd86139-2b32-4d40-bf02-667af96d2553 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1225 microversion: 2.1 time: 0.090485 Sep 15 07:40:12.661474 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 73/142] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:12 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:13.684152 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d4239d56-d0e2-44fb-b686-494e5c177b91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:13.684768 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d4239d56-d0e2-44fb-b686-494e5c177b91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:13.693665 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d4239d56-d0e2-44fb-b686-494e5c177b91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:13.694148 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d4239d56-d0e2-44fb-b686-494e5c177b91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:13.694584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d4239d56-d0e2-44fb-b686-494e5c177b91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:13.695273 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d4239d56-d0e2-44fb-b686-494e5c177b91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:13.695723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d4239d56-d0e2-44fb-b686-494e5c177b91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:13.696145 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d4239d56-d0e2-44fb-b686-494e5c177b91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:13.755949 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d4239d56-d0e2-44fb-b686-494e5c177b91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:13.764098 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d4239d56-d0e2-44fb-b686-494e5c177b91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1225 microversion: 2.1 time: 0.084342 Sep 15 07:40:13.764661 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 70/143] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:13 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:14.789895 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c9dd80ac-af26-46d8-8003-5a8a0e553dd9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:14.790441 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c9dd80ac-af26-46d8-8003-5a8a0e553dd9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:14.798861 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9dd80ac-af26-46d8-8003-5a8a0e553dd9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:14.799494 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9dd80ac-af26-46d8-8003-5a8a0e553dd9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:14.799928 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9dd80ac-af26-46d8-8003-5a8a0e553dd9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:14.800622 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9dd80ac-af26-46d8-8003-5a8a0e553dd9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:14.801073 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9dd80ac-af26-46d8-8003-5a8a0e553dd9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:14.801496 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9dd80ac-af26-46d8-8003-5a8a0e553dd9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:14.868015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c9dd80ac-af26-46d8-8003-5a8a0e553dd9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:14.875971 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c9dd80ac-af26-46d8-8003-5a8a0e553dd9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1217 microversion: 2.1 time: 0.090160 Sep 15 07:40:14.876539 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 74/144] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:14 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:15.902376 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-385d0655-0dc7-48b3-a0f5-06edd31c4de7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:15.904585 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-385d0655-0dc7-48b3-a0f5-06edd31c4de7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:15.916891 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-385d0655-0dc7-48b3-a0f5-06edd31c4de7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:15.918726 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-385d0655-0dc7-48b3-a0f5-06edd31c4de7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:15.919976 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-385d0655-0dc7-48b3-a0f5-06edd31c4de7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:15.920946 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-385d0655-0dc7-48b3-a0f5-06edd31c4de7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:15.921665 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-385d0655-0dc7-48b3-a0f5-06edd31c4de7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:15.922246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-385d0655-0dc7-48b3-a0f5-06edd31c4de7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:16.038950 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-385d0655-0dc7-48b3-a0f5-06edd31c4de7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:16.048951 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-385d0655-0dc7-48b3-a0f5-06edd31c4de7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1281 microversion: 2.1 time: 0.152980 Sep 15 07:40:16.050274 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 71/145] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:15 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:17.077117 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-49a10900-827e-4e8d-a264-99b0c6e70bb0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:17.078004 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-49a10900-827e-4e8d-a264-99b0c6e70bb0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:17.085378 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49a10900-827e-4e8d-a264-99b0c6e70bb0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:17.086306 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49a10900-827e-4e8d-a264-99b0c6e70bb0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:17.087366 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49a10900-827e-4e8d-a264-99b0c6e70bb0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:17.088606 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49a10900-827e-4e8d-a264-99b0c6e70bb0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:17.089332 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49a10900-827e-4e8d-a264-99b0c6e70bb0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:17.090013 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49a10900-827e-4e8d-a264-99b0c6e70bb0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:17.316395 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-49a10900-827e-4e8d-a264-99b0c6e70bb0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:17.326901 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-49a10900-827e-4e8d-a264-99b0c6e70bb0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.253870 Sep 15 07:40:17.343766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 75/146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:17 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:17.508207 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-6429b831-3260-4195-bc12-ffcf3b7cbed9 req-21df60b3-c2ec-41f5-8353-7900125742f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48afb5a2-e7d3-44a4-8882-d81cfd5418ab", "tag": "2a6554f6-3c98-4833-bfe1-d3631c864347"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:17.526102 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-6429b831-3260-4195-bc12-ffcf3b7cbed9 req-21df60b3-c2ec-41f5-8353-7900125742f6 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:17.529313 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-6429b831-3260-4195-bc12-ffcf3b7cbed9 req-21df60b3-c2ec-41f5-8353-7900125742f6 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:17.530020 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-6429b831-3260-4195-bc12-ffcf3b7cbed9 req-21df60b3-c2ec-41f5-8353-7900125742f6 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:17.546749 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-6429b831-3260-4195-bc12-ffcf3b7cbed9 req-21df60b3-c2ec-41f5-8353-7900125742f6 service nova] Creating event network-changed:2a6554f6-3c98-4833-bfe1-d3631c864347 for instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab on hv-cinder-82414 Sep 15 07:40:17.556162 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-6429b831-3260-4195-bc12-ffcf3b7cbed9 req-21df60b3-c2ec-41f5-8353-7900125742f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051485 Sep 15 07:40:17.556969 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 72/147] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:17.869187 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-813367d0-e09d-4f28-9b95-9ed729dd54e1 req-553368b0-0067-47d0-a54a-1ddd7dd4cb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81bf969c-3300-4003-9606-ea44bac82330", "tag": "c255aeb9-c056-475b-98ed-85ece1d8c073"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:17.879681 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-813367d0-e09d-4f28-9b95-9ed729dd54e1 req-553368b0-0067-47d0-a54a-1ddd7dd4cb99 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:17.880156 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-813367d0-e09d-4f28-9b95-9ed729dd54e1 req-553368b0-0067-47d0-a54a-1ddd7dd4cb99 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:17.880601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-813367d0-e09d-4f28-9b95-9ed729dd54e1 req-553368b0-0067-47d0-a54a-1ddd7dd4cb99 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:17.891617 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-813367d0-e09d-4f28-9b95-9ed729dd54e1 req-553368b0-0067-47d0-a54a-1ddd7dd4cb99 service nova] Creating event network-changed:c255aeb9-c056-475b-98ed-85ece1d8c073 for instance 81bf969c-3300-4003-9606-ea44bac82330 on hv-cinder-82414 Sep 15 07:40:17.897051 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-813367d0-e09d-4f28-9b95-9ed729dd54e1 req-553368b0-0067-47d0-a54a-1ddd7dd4cb99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031506 Sep 15 07:40:17.898206 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 76/148] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:18.350649 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-cab478a3-da9e-4f99-9423-e600ce72e102 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:18.356191 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-cab478a3-da9e-4f99-9423-e600ce72e102 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:18.358339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cab478a3-da9e-4f99-9423-e600ce72e102 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:18.358864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cab478a3-da9e-4f99-9423-e600ce72e102 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:18.359296 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cab478a3-da9e-4f99-9423-e600ce72e102 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:18.359986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cab478a3-da9e-4f99-9423-e600ce72e102 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:18.360439 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cab478a3-da9e-4f99-9423-e600ce72e102 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:18.360861 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cab478a3-da9e-4f99-9423-e600ce72e102 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:18.527380 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-cab478a3-da9e-4f99-9423-e600ce72e102 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:18.535808 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-cab478a3-da9e-4f99-9423-e600ce72e102 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.189499 Sep 15 07:40:18.536408 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 73/149] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:18 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:19.559433 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bd2485eb-06b1-462c-bb9f-727b4a0a0c44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:19.565053 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bd2485eb-06b1-462c-bb9f-727b4a0a0c44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:19.566995 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd2485eb-06b1-462c-bb9f-727b4a0a0c44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:19.567476 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd2485eb-06b1-462c-bb9f-727b4a0a0c44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:19.567913 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd2485eb-06b1-462c-bb9f-727b4a0a0c44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:19.568592 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd2485eb-06b1-462c-bb9f-727b4a0a0c44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:19.569043 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd2485eb-06b1-462c-bb9f-727b4a0a0c44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:19.569472 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd2485eb-06b1-462c-bb9f-727b4a0a0c44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:19.720110 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bd2485eb-06b1-462c-bb9f-727b4a0a0c44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:19.727765 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bd2485eb-06b1-462c-bb9f-727b4a0a0c44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.173027 Sep 15 07:40:19.728334 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 77/150] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:19 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:20.752500 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-37aea283-c489-494f-af0b-496aaa32ffc4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:20.753762 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-37aea283-c489-494f-af0b-496aaa32ffc4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:20.765015 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=4 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:20.767838 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-37aea283-c489-494f-af0b-496aaa32ffc4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:20.768464 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-37aea283-c489-494f-af0b-496aaa32ffc4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:20.768913 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-37aea283-c489-494f-af0b-496aaa32ffc4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:20.769867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-37aea283-c489-494f-af0b-496aaa32ffc4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:20.770339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-37aea283-c489-494f-af0b-496aaa32ffc4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:20.770943 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-37aea283-c489-494f-af0b-496aaa32ffc4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:20.906855 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-37aea283-c489-494f-af0b-496aaa32ffc4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:20.914546 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-37aea283-c489-494f-af0b-496aaa32ffc4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.167557 Sep 15 07:40:20.915122 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 74/151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:20 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:21.083987 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b9a862e5-e2da-4d3d-884e-1ba48d05611a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:21.087069 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b9a862e5-e2da-4d3d-884e-1ba48d05611a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:21.087069 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=4 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:21.092282 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b9a862e5-e2da-4d3d-884e-1ba48d05611a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:21.092861 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b9a862e5-e2da-4d3d-884e-1ba48d05611a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:21.093302 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b9a862e5-e2da-4d3d-884e-1ba48d05611a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:21.094033 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b9a862e5-e2da-4d3d-884e-1ba48d05611a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:21.094485 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b9a862e5-e2da-4d3d-884e-1ba48d05611a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:21.094908 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b9a862e5-e2da-4d3d-884e-1ba48d05611a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:21.118361 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b9a862e5-e2da-4d3d-884e-1ba48d05611a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/ips" status: 200 len: 149 microversion: 2.1 time: 0.038135 Sep 15 07:40:21.118796 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 78/152] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 15 07:40:21 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:21.826211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c4377939-48cd-46f2-beb7-976aeae68598 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:21.828253 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c4377939-48cd-46f2-beb7-976aeae68598 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:21.830625 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=14 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:21.840521 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c4377939-48cd-46f2-beb7-976aeae68598 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:21.841184 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c4377939-48cd-46f2-beb7-976aeae68598 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:21.842184 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c4377939-48cd-46f2-beb7-976aeae68598 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:21.842916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c4377939-48cd-46f2-beb7-976aeae68598 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:21.843375 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c4377939-48cd-46f2-beb7-976aeae68598 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:21.843918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c4377939-48cd-46f2-beb7-976aeae68598 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:21.919020 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c4377939-48cd-46f2-beb7-976aeae68598 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/ips" status: 200 len: 151 microversion: 2.20 time: 0.085757 Sep 15 07:40:21.924242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 75/153] 10.222.0.42 () {60 vars in 1289 bytes} [Thu Sep 15 07:40:21 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/ips => generated 151 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:40:21.944314 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fab5559f-870d-48c7-bddd-f7c452f55d18 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:21.945412 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-fab5559f-870d-48c7-bddd-f7c452f55d18 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:21.970748 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fab5559f-870d-48c7-bddd-f7c452f55d18 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:21.974012 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fab5559f-870d-48c7-bddd-f7c452f55d18 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:21.974494 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fab5559f-870d-48c7-bddd-f7c452f55d18 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:21.975226 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fab5559f-870d-48c7-bddd-f7c452f55d18 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:21.975686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fab5559f-870d-48c7-bddd-f7c452f55d18 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:21.978237 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fab5559f-870d-48c7-bddd-f7c452f55d18 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:22.268011 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-fab5559f-870d-48c7-bddd-f7c452f55d18 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:22.276340 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fab5559f-870d-48c7-bddd-f7c452f55d18 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.343853 Sep 15 07:40:22.276911 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 79/154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:21 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:23.083115 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c8bc5b12-176a-4511-aa5d-948ab1dfb553 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acc6d41d-3822-431f-bff8-c8b34f88bfc4"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:23.085487 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c8bc5b12-176a-4511-aa5d-948ab1dfb553 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:23.091544 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b12-176a-4511-aa5d-948ab1dfb553 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:23.092277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b12-176a-4511-aa5d-948ab1dfb553 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:23.092722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b12-176a-4511-aa5d-948ab1dfb553 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:23.093425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b12-176a-4511-aa5d-948ab1dfb553 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:23.093916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b12-176a-4511-aa5d-948ab1dfb553 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:23.094370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bc5b12-176a-4511-aa5d-948ab1dfb553 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:23.298814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-49793719-5d02-465c-96e3-beff4194775b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:23.299588 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-49793719-5d02-465c-96e3-beff4194775b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:23.306060 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49793719-5d02-465c-96e3-beff4194775b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:23.306545 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49793719-5d02-465c-96e3-beff4194775b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:23.306981 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49793719-5d02-465c-96e3-beff4194775b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:23.307666 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49793719-5d02-465c-96e3-beff4194775b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:23.308114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49793719-5d02-465c-96e3-beff4194775b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:23.308703 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-49793719-5d02-465c-96e3-beff4194775b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:23.445810 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-49793719-5d02-465c-96e3-beff4194775b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:23.453614 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-49793719-5d02-465c-96e3-beff4194775b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.159196 Sep 15 07:40:23.454184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 80/155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:23 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:24.477729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-06d51e9c-babe-44d9-baac-19669396c849 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:24.478422 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-06d51e9c-babe-44d9-baac-19669396c849 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:24.486076 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06d51e9c-babe-44d9-baac-19669396c849 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:24.486646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06d51e9c-babe-44d9-baac-19669396c849 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:24.487155 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06d51e9c-babe-44d9-baac-19669396c849 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:24.487942 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06d51e9c-babe-44d9-baac-19669396c849 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:24.488468 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06d51e9c-babe-44d9-baac-19669396c849 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:24.488973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06d51e9c-babe-44d9-baac-19669396c849 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:24.622663 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-06d51e9c-babe-44d9-baac-19669396c849 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:24.631853 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-06d51e9c-babe-44d9-baac-19669396c849 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.157858 Sep 15 07:40:24.632621 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 81/156] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:24 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:25.655379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-68de0510-6a72-4a4d-b78e-bfcdc3d64fee tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:25.658451 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-68de0510-6a72-4a4d-b78e-bfcdc3d64fee tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:25.662405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68de0510-6a72-4a4d-b78e-bfcdc3d64fee tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:25.662885 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68de0510-6a72-4a4d-b78e-bfcdc3d64fee tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:25.663355 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68de0510-6a72-4a4d-b78e-bfcdc3d64fee tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:25.664036 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68de0510-6a72-4a4d-b78e-bfcdc3d64fee tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:25.664484 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68de0510-6a72-4a4d-b78e-bfcdc3d64fee tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:25.664905 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68de0510-6a72-4a4d-b78e-bfcdc3d64fee tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:25.798656 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-68de0510-6a72-4a4d-b78e-bfcdc3d64fee tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:25.806446 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-68de0510-6a72-4a4d-b78e-bfcdc3d64fee tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.155954 Sep 15 07:40:25.807009 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 82/157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:25 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:26.830534 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-71b5b95e-2257-4272-a6ee-a4ca168e4bb9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:26.831209 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-71b5b95e-2257-4272-a6ee-a4ca168e4bb9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:26.838674 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b5b95e-2257-4272-a6ee-a4ca168e4bb9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:26.839446 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b5b95e-2257-4272-a6ee-a4ca168e4bb9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:26.839913 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b5b95e-2257-4272-a6ee-a4ca168e4bb9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:26.840642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b5b95e-2257-4272-a6ee-a4ca168e4bb9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:26.841132 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b5b95e-2257-4272-a6ee-a4ca168e4bb9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:26.841565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b5b95e-2257-4272-a6ee-a4ca168e4bb9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:26.908077 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c8bc5b12-176a-4511-aa5d-948ab1dfb553 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.829027 Sep 15 07:40:26.909505 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 76/158] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:40:23 2022] POST /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments => generated 194 bytes in 3831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:26.994083 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-71b5b95e-2257-4272-a6ee-a4ca168e4bb9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:27.001732 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-71b5b95e-2257-4272-a6ee-a4ca168e4bb9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.176491 Sep 15 07:40:27.002508 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 83/159] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:26 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:27.521779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8000c28f-438f-4009-be92-a28bb2584c65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:27.522299 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8000c28f-438f-4009-be92-a28bb2584c65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:27.531784 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8000c28f-438f-4009-be92-a28bb2584c65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:27.539461 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8000c28f-438f-4009-be92-a28bb2584c65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:27.539461 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8000c28f-438f-4009-be92-a28bb2584c65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:27.539461 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8000c28f-438f-4009-be92-a28bb2584c65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:27.539461 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8000c28f-438f-4009-be92-a28bb2584c65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:27.539997 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8000c28f-438f-4009-be92-a28bb2584c65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:27.574859 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-8000c28f-438f-4009-be92-a28bb2584c65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lazy-loading 'flavor' on Instance uuid 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:40:28.027006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9fa5f6fa-80bf-496e-8592-4d5f34b802f9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:28.027640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9fa5f6fa-80bf-496e-8592-4d5f34b802f9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:28.038890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa5f6fa-80bf-496e-8592-4d5f34b802f9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:28.039381 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa5f6fa-80bf-496e-8592-4d5f34b802f9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:28.039814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa5f6fa-80bf-496e-8592-4d5f34b802f9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:28.040515 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa5f6fa-80bf-496e-8592-4d5f34b802f9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:28.040967 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa5f6fa-80bf-496e-8592-4d5f34b802f9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:28.041427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa5f6fa-80bf-496e-8592-4d5f34b802f9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:28.153351 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8000c28f-438f-4009-be92-a28bb2584c65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "POST /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/action" status: 202 len: 0 microversion: 2.20 time: 0.635895 Sep 15 07:40:28.164745 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 77/160] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 15 07:40:27 2022] POST /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:40:28.174980 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:28.178384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:28.192095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:28.192853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:28.195227 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:28.196326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:28.197448 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:28.198751 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:28.205804 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9fa5f6fa-80bf-496e-8592-4d5f34b802f9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:28.216427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9fa5f6fa-80bf-496e-8592-4d5f34b802f9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.193485 Sep 15 07:40:28.216427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 84/161] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:28 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:28.345562 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-583c02d9-d281-47bc-b2b8-1e425a9acb38 req-911bef1e-3774-4f01-83f5-19b0ab792bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48afb5a2-e7d3-44a4-8882-d81cfd5418ab", "name": "network-vif-plugged", "status": "completed", "tag": "2a6554f6-3c98-4833-bfe1-d3631c864347"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:28.355789 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:28.358961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-583c02d9-d281-47bc-b2b8-1e425a9acb38 req-911bef1e-3774-4f01-83f5-19b0ab792bf8 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:28.358961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-583c02d9-d281-47bc-b2b8-1e425a9acb38 req-911bef1e-3774-4f01-83f5-19b0ab792bf8 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:28.358961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-583c02d9-d281-47bc-b2b8-1e425a9acb38 req-911bef1e-3774-4f01-83f5-19b0ab792bf8 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:28.370237 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-583c02d9-d281-47bc-b2b8-1e425a9acb38 req-911bef1e-3774-4f01-83f5-19b0ab792bf8 service nova] Creating event network-vif-plugged:2a6554f6-3c98-4833-bfe1-d3631c864347 for instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab on hv-cinder-82414 Sep 15 07:40:28.372511 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:28.374361 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:28.375665 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-583c02d9-d281-47bc-b2b8-1e425a9acb38 req-911bef1e-3774-4f01-83f5-19b0ab792bf8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034660 Sep 15 07:40:28.375806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7c700e30-067f-47d3-b30f-079dd23d01d8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.209607 Sep 15 07:40:28.376363 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 78/162] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:28 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:28.376841 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 85/163] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:40:28.780994 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-716738736", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452"}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:28.837546 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.network.neutron [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] validate_networks() for None {{(pid=132674) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:40:29.238755 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-fa90f32c-4194-4dfd-bdaa-2e2e98a9e35a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:29.239634 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-fa90f32c-4194-4dfd-bdaa-2e2e98a9e35a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:29.246369 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa90f32c-4194-4dfd-bdaa-2e2e98a9e35a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:29.246852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa90f32c-4194-4dfd-bdaa-2e2e98a9e35a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:29.247291 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa90f32c-4194-4dfd-bdaa-2e2e98a9e35a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:29.247982 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa90f32c-4194-4dfd-bdaa-2e2e98a9e35a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:29.249210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa90f32c-4194-4dfd-bdaa-2e2e98a9e35a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:29.249709 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa90f32c-4194-4dfd-bdaa-2e2e98a9e35a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:29.352583 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Flavor limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:40:29.353080 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Image limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:40:29.353515 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Flavor pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:40:29.353953 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Image pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:40:29.354366 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:40:29.364222 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:29.370324 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:29.370324 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:29.370324 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:29.370324 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:29.370836 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:29.386548 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Getting quotas for project e0730e401f844b55a78df53dba8e4b5c. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:40:29.394283 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Getting quotas for user 82e55686994a4e6b86096cc21c52085d and project e0730e401f844b55a78df53dba8e4b5c. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:40:29.408682 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Going to run 1 instances... {{(pid=132674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:40:29.411571 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:40:29.432319 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fa90f32c-4194-4dfd-bdaa-2e2e98a9e35a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:29.441944 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-fa90f32c-4194-4dfd-bdaa-2e2e98a9e35a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.206989 Sep 15 07:40:29.442595 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 79/164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:29 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:29.447360 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:29.448571 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:29.456314 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:29.457029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:29.462132 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:29.462132 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:29.462132 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:29.462132 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:29.549220 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b7006160-b59a-44a5-b792-781035f84f17 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773422 Sep 15 07:40:29.560163 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 86/165] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:40:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:40:29.580201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-06349d63-8eb1-4764-a36b-7bd02c1afb94 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:29.580831 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-06349d63-8eb1-4764-a36b-7bd02c1afb94 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:29.635071 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:29.659018 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:29.660612 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:29.662294 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-39438893-a7cd-43ee-bc97-25ac19472759 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.218294 Sep 15 07:40:29.663002 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 80/166] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:29 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:29.675355 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-06349d63-8eb1-4764-a36b-7bd02c1afb94 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:29.688459 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-06349d63-8eb1-4764-a36b-7bd02c1afb94 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1214 microversion: 2.1 time: 0.112872 Sep 15 07:40:29.689511 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 87/167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:29 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:30.390940 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-d5770f6f-43a7-423b-9891-9c2f971848a1 req-ccda6f1d-0cf1-4987-b36d-56d0f3a03990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81bf969c-3300-4003-9606-ea44bac82330", "name": "network-vif-plugged", "status": "completed", "tag": "c255aeb9-c056-475b-98ed-85ece1d8c073"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:30.405531 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-d5770f6f-43a7-423b-9891-9c2f971848a1 req-ccda6f1d-0cf1-4987-b36d-56d0f3a03990 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:30.406032 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-d5770f6f-43a7-423b-9891-9c2f971848a1 req-ccda6f1d-0cf1-4987-b36d-56d0f3a03990 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:30.406622 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-d5770f6f-43a7-423b-9891-9c2f971848a1 req-ccda6f1d-0cf1-4987-b36d-56d0f3a03990 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:30.420870 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-d5770f6f-43a7-423b-9891-9c2f971848a1 req-ccda6f1d-0cf1-4987-b36d-56d0f3a03990 service nova] Creating event network-vif-plugged:c255aeb9-c056-475b-98ed-85ece1d8c073 for instance 81bf969c-3300-4003-9606-ea44bac82330 on hv-cinder-82414 Sep 15 07:40:30.426304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-d5770f6f-43a7-423b-9891-9c2f971848a1 req-ccda6f1d-0cf1-4987-b36d-56d0f3a03990 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038855 Sep 15 07:40:30.427119 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 81/168] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:30.468953 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3d2cded4-1c31-4f1c-a8ca-666425c1baab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:30.469710 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3d2cded4-1c31-4f1c-a8ca-666425c1baab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:30.476491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d2cded4-1c31-4f1c-a8ca-666425c1baab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:30.477035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d2cded4-1c31-4f1c-a8ca-666425c1baab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:30.477688 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d2cded4-1c31-4f1c-a8ca-666425c1baab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:30.478594 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d2cded4-1c31-4f1c-a8ca-666425c1baab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:30.479251 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d2cded4-1c31-4f1c-a8ca-666425c1baab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:30.479972 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d2cded4-1c31-4f1c-a8ca-666425c1baab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:30.619016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3d2cded4-1c31-4f1c-a8ca-666425c1baab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:30.627375 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3d2cded4-1c31-4f1c-a8ca-666425c1baab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.162880 Sep 15 07:40:30.628316 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 88/169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:30 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:30.688391 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:30.688972 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:30.695693 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:30.696185 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:30.696619 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:30.697818 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:30.698459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:30.699047 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:30.715147 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e915f3df-608a-4171-99f0-e4fdbb6a0c85 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:30.715766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e915f3df-608a-4171-99f0-e4fdbb6a0c85 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:30.799824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e915f3df-608a-4171-99f0-e4fdbb6a0c85 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:30.807798 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e915f3df-608a-4171-99f0-e4fdbb6a0c85 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1214 microversion: 2.1 time: 0.096732 Sep 15 07:40:30.808580 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 89/170] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:30 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:30.867367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:30.876972 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:30.878451 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:30.879616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8a791847-9b6b-4c58-85e7-cf64047a785a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.196015 Sep 15 07:40:30.880180 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 82/171] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:30 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:31.650946 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-cbe02371-bf1d-4698-8278-5b0ee2371d75 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:31.651555 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-cbe02371-bf1d-4698-8278-5b0ee2371d75 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:31.658865 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbe02371-bf1d-4698-8278-5b0ee2371d75 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:31.659352 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbe02371-bf1d-4698-8278-5b0ee2371d75 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:31.659783 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbe02371-bf1d-4698-8278-5b0ee2371d75 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:31.660467 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbe02371-bf1d-4698-8278-5b0ee2371d75 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:31.660912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbe02371-bf1d-4698-8278-5b0ee2371d75 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:31.661328 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbe02371-bf1d-4698-8278-5b0ee2371d75 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:31.800254 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-cbe02371-bf1d-4698-8278-5b0ee2371d75 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:31.808000 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-cbe02371-bf1d-4698-8278-5b0ee2371d75 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1321 microversion: 2.1 time: 0.160958 Sep 15 07:40:31.808591 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 90/172] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:31 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:31.831579 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2018f343-c130-4d94-9645-9ac01eda1a9d tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:31.832231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2018f343-c130-4d94-9645-9ac01eda1a9d tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:31.838881 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2018f343-c130-4d94-9645-9ac01eda1a9d tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:31.839336 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2018f343-c130-4d94-9645-9ac01eda1a9d tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:31.839911 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2018f343-c130-4d94-9645-9ac01eda1a9d tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:31.840606 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2018f343-c130-4d94-9645-9ac01eda1a9d tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:31.841221 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2018f343-c130-4d94-9645-9ac01eda1a9d tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:31.841707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2018f343-c130-4d94-9645-9ac01eda1a9d tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:31.906266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:31.907259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:31.910927 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-2018f343-c130-4d94-9645-9ac01eda1a9d tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:31.913448 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:31.914173 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:31.914928 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:31.915972 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:31.916607 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:31.917172 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:31.924150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2018f343-c130-4d94-9645-9ac01eda1a9d tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1210 microversion: 2.1 time: 0.096241 Sep 15 07:40:31.925283 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 83/173] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:31 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:32.084142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:32.097120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:32.098979 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:32.100391 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-11c0e13e-8c73-4d4d-b383-f273a954bdfb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.198858 Sep 15 07:40:32.101031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 91/174] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:31 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:32.831507 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0bfa8042-e7db-47f1-8ccb-4c6e8e003300 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:32.832636 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0bfa8042-e7db-47f1-8ccb-4c6e8e003300 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:32.844163 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0bfa8042-e7db-47f1-8ccb-4c6e8e003300 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:32.844655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0bfa8042-e7db-47f1-8ccb-4c6e8e003300 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:32.845089 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0bfa8042-e7db-47f1-8ccb-4c6e8e003300 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:32.845817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0bfa8042-e7db-47f1-8ccb-4c6e8e003300 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:32.846269 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0bfa8042-e7db-47f1-8ccb-4c6e8e003300 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:32.846690 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0bfa8042-e7db-47f1-8ccb-4c6e8e003300 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:32.851225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:32.955022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-399d4dc8-19ed-4ab3-bf0c-b0fef165f2c1 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:32.955022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-399d4dc8-19ed-4ab3-bf0c-b0fef165f2c1 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:32.962177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-399d4dc8-19ed-4ab3-bf0c-b0fef165f2c1 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:32.966888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-399d4dc8-19ed-4ab3-bf0c-b0fef165f2c1 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:32.966888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-399d4dc8-19ed-4ab3-bf0c-b0fef165f2c1 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:32.966888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-399d4dc8-19ed-4ab3-bf0c-b0fef165f2c1 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:32.966888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-399d4dc8-19ed-4ab3-bf0c-b0fef165f2c1 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:32.967259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-399d4dc8-19ed-4ab3-bf0c-b0fef165f2c1 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:33.020263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0bfa8042-e7db-47f1-8ccb-4c6e8e003300 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:33.031093 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0bfa8042-e7db-47f1-8ccb-4c6e8e003300 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1516 microversion: 2.1 time: 0.203437 Sep 15 07:40:33.031862 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 84/175] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:32 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1516 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:33.038425 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-399d4dc8-19ed-4ab3-bf0c-b0fef165f2c1 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:33.047161 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-399d4dc8-19ed-4ab3-bf0c-b0fef165f2c1 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1266 microversion: 2.1 time: 0.100929 Sep 15 07:40:33.058994 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 92/176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:32 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:33.059097 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ad9422e0-181f-419f-a54b-155146caa2f6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:33.061604 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ad9422e0-181f-419f-a54b-155146caa2f6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:33.068108 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad9422e0-181f-419f-a54b-155146caa2f6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:33.068793 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad9422e0-181f-419f-a54b-155146caa2f6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:33.069399 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad9422e0-181f-419f-a54b-155146caa2f6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:33.070334 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad9422e0-181f-419f-a54b-155146caa2f6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:33.071114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad9422e0-181f-419f-a54b-155146caa2f6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:33.071951 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad9422e0-181f-419f-a54b-155146caa2f6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:33.105480 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-ad9422e0-181f-419f-a54b-155146caa2f6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lazy-loading 'flavor' on Instance uuid 81bf969c-3300-4003-9606-ea44bac82330 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:40:33.131215 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:33.132430 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:33.140552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:33.141671 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:33.143411 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:33.144997 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:33.145811 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:33.146870 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:33.325660 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:33.335200 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:33.338664 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:33.340125 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:33.341745 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-882640e4-d03a-4203-9f09-78da3cc6d1d2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.216374 Sep 15 07:40:33.349753 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 93/177] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:33 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:40:33.435223 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ad9422e0-181f-419f-a54b-155146caa2f6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "POST /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330/action" status: 200 len: 32 microversion: 2.1 time: 0.382583 Sep 15 07:40:33.435966 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 85/178] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:40:33 2022] POST /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330/action => generated 32 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 07:40:33.446514 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f66dc2a1-a3d1-4389-85df-91cf43d4f53b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:33.447838 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f66dc2a1-a3d1-4389-85df-91cf43d4f53b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:33.455186 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f66dc2a1-a3d1-4389-85df-91cf43d4f53b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:33.455753 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f66dc2a1-a3d1-4389-85df-91cf43d4f53b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:33.456274 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f66dc2a1-a3d1-4389-85df-91cf43d4f53b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:33.457215 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f66dc2a1-a3d1-4389-85df-91cf43d4f53b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:33.464695 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f66dc2a1-a3d1-4389-85df-91cf43d4f53b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:33.465247 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f66dc2a1-a3d1-4389-85df-91cf43d4f53b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:33.678722 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f66dc2a1-a3d1-4389-85df-91cf43d4f53b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:33.690870 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f66dc2a1-a3d1-4389-85df-91cf43d4f53b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.248650 Sep 15 07:40:33.692049 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 94/179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:33 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:34.079618 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5a854c37-4b19-42bf-aa8f-affc9fd9fcb4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:34.080398 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5a854c37-4b19-42bf-aa8f-affc9fd9fcb4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:34.087445 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a854c37-4b19-42bf-aa8f-affc9fd9fcb4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:34.088322 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a854c37-4b19-42bf-aa8f-affc9fd9fcb4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:34.090466 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a854c37-4b19-42bf-aa8f-affc9fd9fcb4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:34.093134 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a854c37-4b19-42bf-aa8f-affc9fd9fcb4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:34.093918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a854c37-4b19-42bf-aa8f-affc9fd9fcb4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:34.094534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a854c37-4b19-42bf-aa8f-affc9fd9fcb4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:34.197155 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5a854c37-4b19-42bf-aa8f-affc9fd9fcb4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:34.206164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5a854c37-4b19-42bf-aa8f-affc9fd9fcb4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1272 microversion: 2.1 time: 0.131916 Sep 15 07:40:34.207430 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 86/180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:34 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:34.372242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:34.372868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:34.379737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:34.381042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:34.381479 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:34.382418 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:34.383061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:34.383652 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:34.556072 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1956be3b-87d7-43ba-a939-b46b6880683b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: .version_select at 0x7ff36ca85430>, body: {"keypair": {"name": "tempest-keypair-232708889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJuKX+9aUGINP3mbqgzp//FmKD+xmXc2iCdeVPZbDJkvJH3FaXytI5Ji+mFe+UVpfg5HjPs5Z8f8uLJcdKjZB/F9gwmD8dFx4PBlh6ltH/hcm8GGUROlEr3d0LNSonL3Q=="}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:34.573407 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-1956be3b-87d7-43ba-a939-b46b6880683b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for project 14017d5edbbd4068b529d5d92444182a. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:40:34.585061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-1956be3b-87d7-43ba-a939-b46b6880683b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for user 5e0c8d7aa4db455a94631becf212866f and project 14017d5edbbd4068b529d5d92444182a. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:40:34.647208 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:34.666863 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:34.668687 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:34.669542 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d101a8b4-46da-4659-ba24-8bcb248e7c9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.302199 Sep 15 07:40:34.670139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 95/181] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:34 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:34.713928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-1956be3b-87d7-43ba-a939-b46b6880683b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.162938 Sep 15 07:40:34.721632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 87/182] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 15 07:40:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:34.722418 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-67e97bba-98d3-46eb-8ec2-ecae6625b616 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:34.724100 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-67e97bba-98d3-46eb-8ec2-ecae6625b616 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:34.732340 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-67e97bba-98d3-46eb-8ec2-ecae6625b616 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:34.733390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-67e97bba-98d3-46eb-8ec2-ecae6625b616 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:34.735093 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-67e97bba-98d3-46eb-8ec2-ecae6625b616 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:34.736281 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-67e97bba-98d3-46eb-8ec2-ecae6625b616 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:34.736986 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-67e97bba-98d3-46eb-8ec2-ecae6625b616 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:34.738184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-67e97bba-98d3-46eb-8ec2-ecae6625b616 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:34.916595 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-67e97bba-98d3-46eb-8ec2-ecae6625b616 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:34.926839 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-67e97bba-98d3-46eb-8ec2-ecae6625b616 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.216094 Sep 15 07:40:34.928895 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 96/183] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:34 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:35.235515 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4f437e78-c0f1-4a1a-b549-ccf70e7c18be tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:35.236220 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4f437e78-c0f1-4a1a-b549-ccf70e7c18be tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:35.244810 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4f437e78-c0f1-4a1a-b549-ccf70e7c18be tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:35.245784 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4f437e78-c0f1-4a1a-b549-ccf70e7c18be tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:35.251896 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4f437e78-c0f1-4a1a-b549-ccf70e7c18be tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:35.251896 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4f437e78-c0f1-4a1a-b549-ccf70e7c18be tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:35.251896 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4f437e78-c0f1-4a1a-b549-ccf70e7c18be tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:35.251896 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4f437e78-c0f1-4a1a-b549-ccf70e7c18be tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:35.486816 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4f437e78-c0f1-4a1a-b549-ccf70e7c18be tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:35.498276 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4f437e78-c0f1-4a1a-b549-ccf70e7c18be tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1314 microversion: 2.1 time: 0.267746 Sep 15 07:40:35.499679 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 88/184] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:35 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:35.700807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:35.700807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:35.708988 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:35.709721 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:35.710375 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:35.711285 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:35.712182 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:35.713405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:35.915992 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:35.925181 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:35.926812 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:35.928005 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0960104d-5e8a-4f30-850b-3be10dfb381a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.235494 Sep 15 07:40:35.928569 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 97/185] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:35 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:35.957334 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a508b564-0051-4569-815e-13d5e4d3c370 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:35.957992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a508b564-0051-4569-815e-13d5e4d3c370 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:35.965355 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a508b564-0051-4569-815e-13d5e4d3c370 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:35.965886 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a508b564-0051-4569-815e-13d5e4d3c370 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:35.969702 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a508b564-0051-4569-815e-13d5e4d3c370 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:35.969702 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a508b564-0051-4569-815e-13d5e4d3c370 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:35.969702 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a508b564-0051-4569-815e-13d5e4d3c370 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:35.969702 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a508b564-0051-4569-815e-13d5e4d3c370 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:36.182490 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a508b564-0051-4569-815e-13d5e4d3c370 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:36.195441 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a508b564-0051-4569-815e-13d5e4d3c370 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.245449 Sep 15 07:40:36.196327 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 89/186] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:35 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:36.285505 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-495b6884-00b2-47fc-8d39-11192d102dc6 req-a1d4903f-df7a-49de-ac44-083eb95c1274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9614c29-883e-453c-afa9-5fd85d5e4cac", "tag": "639ec1c3-62f0-47df-8bdc-a50dd0cc3a4a"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:36.296276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-495b6884-00b2-47fc-8d39-11192d102dc6 req-a1d4903f-df7a-49de-ac44-083eb95c1274 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:36.297107 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-495b6884-00b2-47fc-8d39-11192d102dc6 req-a1d4903f-df7a-49de-ac44-083eb95c1274 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:36.297550 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-495b6884-00b2-47fc-8d39-11192d102dc6 req-a1d4903f-df7a-49de-ac44-083eb95c1274 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:36.310792 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-495b6884-00b2-47fc-8d39-11192d102dc6 req-a1d4903f-df7a-49de-ac44-083eb95c1274 service nova] Creating event network-changed:639ec1c3-62f0-47df-8bdc-a50dd0cc3a4a for instance d9614c29-883e-453c-afa9-5fd85d5e4cac on hv-cinder-82414 Sep 15 07:40:36.316506 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-495b6884-00b2-47fc-8d39-11192d102dc6 req-a1d4903f-df7a-49de-ac44-083eb95c1274 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036649 Sep 15 07:40:36.317346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 98/187] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:36.524433 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-416043e3-3849-46f2-b3ac-beba9ffc3d59 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:36.525767 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-416043e3-3849-46f2-b3ac-beba9ffc3d59 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:36.531853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-416043e3-3849-46f2-b3ac-beba9ffc3d59 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:36.532516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-416043e3-3849-46f2-b3ac-beba9ffc3d59 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:36.533052 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-416043e3-3849-46f2-b3ac-beba9ffc3d59 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:36.533963 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-416043e3-3849-46f2-b3ac-beba9ffc3d59 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:36.534653 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-416043e3-3849-46f2-b3ac-beba9ffc3d59 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:36.535184 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-416043e3-3849-46f2-b3ac-beba9ffc3d59 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:36.687393 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-416043e3-3849-46f2-b3ac-beba9ffc3d59 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:36.695658 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-416043e3-3849-46f2-b3ac-beba9ffc3d59 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1314 microversion: 2.1 time: 0.176189 Sep 15 07:40:36.696558 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 90/188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:36 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:36.956659 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:36.957412 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:36.966014 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:36.966702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:36.968761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:36.969516 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:36.970142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:36.970710 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:37.142013 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:37.150294 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:37.151773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:37.152959 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3c66f66c-2a3a-4f47-9d81-4dd90fabfc13 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.202276 Sep 15 07:40:37.157970 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 99/189] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:36 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:37.220351 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-41e171a6-6d66-469c-8eb2-de2b4fa88709 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:37.221185 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-41e171a6-6d66-469c-8eb2-de2b4fa88709 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:37.227548 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e171a6-6d66-469c-8eb2-de2b4fa88709 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:37.228037 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e171a6-6d66-469c-8eb2-de2b4fa88709 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:37.228641 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e171a6-6d66-469c-8eb2-de2b4fa88709 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:37.229503 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e171a6-6d66-469c-8eb2-de2b4fa88709 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:37.230003 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e171a6-6d66-469c-8eb2-de2b4fa88709 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:37.230631 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e171a6-6d66-469c-8eb2-de2b4fa88709 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:37.419430 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-41e171a6-6d66-469c-8eb2-de2b4fa88709 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:37.428413 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-41e171a6-6d66-469c-8eb2-de2b4fa88709 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.212606 Sep 15 07:40:37.442409 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 91/190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:37 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:37.720052 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-21bc4c63-1e7c-4614-8031-bb026ed519a6 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:37.720681 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-21bc4c63-1e7c-4614-8031-bb026ed519a6 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:37.726714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21bc4c63-1e7c-4614-8031-bb026ed519a6 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:37.727207 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21bc4c63-1e7c-4614-8031-bb026ed519a6 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:37.727648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21bc4c63-1e7c-4614-8031-bb026ed519a6 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:37.728349 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21bc4c63-1e7c-4614-8031-bb026ed519a6 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:37.728808 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21bc4c63-1e7c-4614-8031-bb026ed519a6 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:37.729238 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21bc4c63-1e7c-4614-8031-bb026ed519a6 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:37.865621 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-21bc4c63-1e7c-4614-8031-bb026ed519a6 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:37.873218 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-21bc4c63-1e7c-4614-8031-bb026ed519a6 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1314 microversion: 2.1 time: 0.157182 Sep 15 07:40:37.874289 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 100/191] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:37 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:38.127994 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1636034851", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be4fe7de-ab91-47eb-96fc-2000373fe74e"}], "security_groups": [{"name": "tempest-securitygroup--1635715081"}], "key_name": "tempest-keypair-232708889", "user_data": "}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:38.179530 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:38.180710 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:38.187146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:38.190109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:38.190109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:38.190109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:38.190109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:38.190754 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:38.310437 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] validate_networks() for [('be4fe7de-ab91-47eb-96fc-2000373fe74e', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:40:38.482656 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:38.494100 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:38.499368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:38.499368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-19dd4902-8704-4eda-b208-ea16bb4bdc82 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.321516 Sep 15 07:40:38.499368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 101/192] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:38 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:38.503179 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4c80eb65-c458-485f-9f10-9e84bda4e6f7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:38.503781 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-4c80eb65-c458-485f-9f10-9e84bda4e6f7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:38.509947 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c80eb65-c458-485f-9f10-9e84bda4e6f7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:38.510435 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c80eb65-c458-485f-9f10-9e84bda4e6f7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:38.510865 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c80eb65-c458-485f-9f10-9e84bda4e6f7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:38.511664 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c80eb65-c458-485f-9f10-9e84bda4e6f7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:38.512112 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c80eb65-c458-485f-9f10-9e84bda4e6f7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:38.512701 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c80eb65-c458-485f-9f10-9e84bda4e6f7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:38.749988 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4c80eb65-c458-485f-9f10-9e84bda4e6f7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:38.765956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4c80eb65-c458-485f-9f10-9e84bda4e6f7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.267160 Sep 15 07:40:38.766543 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 102/193] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:38 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:38.872695 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:40:38.873469 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:40:38.874012 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:40:38.874629 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:40:38.875095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:40:38.891300 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:38.895576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:38.895576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:38.895576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:38.895576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:38.895996 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:38.900628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bc90c541-3b47-4702-95b3-270c357bb7d4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:38.901481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bc90c541-3b47-4702-95b3-270c357bb7d4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:38.908592 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc90c541-3b47-4702-95b3-270c357bb7d4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:38.909285 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc90c541-3b47-4702-95b3-270c357bb7d4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:38.909976 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc90c541-3b47-4702-95b3-270c357bb7d4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:38.910790 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc90c541-3b47-4702-95b3-270c357bb7d4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:38.911354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc90c541-3b47-4702-95b3-270c357bb7d4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:38.911885 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc90c541-3b47-4702-95b3-270c357bb7d4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:38.913567 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for project 14017d5edbbd4068b529d5d92444182a. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:40:38.917306 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:38.919151 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for user 5e0c8d7aa4db455a94631becf212866f and project 14017d5edbbd4068b529d5d92444182a. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:40:38.932321 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:40:38.934632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:40:39.069440 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bc90c541-3b47-4702-95b3-270c357bb7d4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:39.078207 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bc90c541-3b47-4702-95b3-270c357bb7d4 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1314 microversion: 2.1 time: 0.181201 Sep 15 07:40:39.082389 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 103/194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:38 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:39.115356 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a6ed0d7f-8747-43e4-83c4-a9eed2d49265 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.991882 Sep 15 07:40:39.116413 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 92/195] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:40:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:40:39.127954 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ddaab9bf-00ef-492c-a1c6-0837d6649740 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:39.128561 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ddaab9bf-00ef-492c-a1c6-0837d6649740 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:39.183973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ddaab9bf-00ef-492c-a1c6-0837d6649740 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:39.191830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ddaab9bf-00ef-492c-a1c6-0837d6649740 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1241 microversion: 2.1 time: 0.068158 Sep 15 07:40:39.196325 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 104/196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:39 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:39.524292 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:39.525080 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:39.533867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:39.534339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:39.534770 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:39.535468 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:39.535917 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:39.536332 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:39.682855 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:39.695649 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:39.697235 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:39.698459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6d4b46e3-d7cd-441c-b87c-aa5640dfd1b0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.178516 Sep 15 07:40:39.713719 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 93/197] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:39 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:39.789168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fbb6a593-4b05-4f4c-8387-164c851d65eb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:39.790169 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-fbb6a593-4b05-4f4c-8387-164c851d65eb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:39.793363 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:39.798712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fbb6a593-4b05-4f4c-8387-164c851d65eb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:39.800465 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fbb6a593-4b05-4f4c-8387-164c851d65eb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:39.800465 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fbb6a593-4b05-4f4c-8387-164c851d65eb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:39.800465 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fbb6a593-4b05-4f4c-8387-164c851d65eb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:39.800772 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fbb6a593-4b05-4f4c-8387-164c851d65eb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:39.801202 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fbb6a593-4b05-4f4c-8387-164c851d65eb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:39.959128 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-fbb6a593-4b05-4f4c-8387-164c851d65eb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:39.971202 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fbb6a593-4b05-4f4c-8387-164c851d65eb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.185606 Sep 15 07:40:39.971931 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 105/198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:39 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:40.103357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f3fd86bb-5d67-4f2b-9269-041575fef820 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:40.104023 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f3fd86bb-5d67-4f2b-9269-041575fef820 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:40.110965 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3fd86bb-5d67-4f2b-9269-041575fef820 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:40.111444 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3fd86bb-5d67-4f2b-9269-041575fef820 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:40.111876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3fd86bb-5d67-4f2b-9269-041575fef820 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:40.112643 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3fd86bb-5d67-4f2b-9269-041575fef820 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:40.113095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3fd86bb-5d67-4f2b-9269-041575fef820 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:40.113511 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f3fd86bb-5d67-4f2b-9269-041575fef820 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:40.216609 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-dd355bfd-16d9-49f4-8fd4-d6455c2875c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:40.218382 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-dd355bfd-16d9-49f4-8fd4-d6455c2875c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:40.227733 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd355bfd-16d9-49f4-8fd4-d6455c2875c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:40.229102 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd355bfd-16d9-49f4-8fd4-d6455c2875c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:40.230181 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd355bfd-16d9-49f4-8fd4-d6455c2875c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:40.231681 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd355bfd-16d9-49f4-8fd4-d6455c2875c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:40.233199 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd355bfd-16d9-49f4-8fd4-d6455c2875c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:40.234373 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd355bfd-16d9-49f4-8fd4-d6455c2875c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:40.260392 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f3fd86bb-5d67-4f2b-9269-041575fef820 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:40.269842 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f3fd86bb-5d67-4f2b-9269-041575fef820 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1314 microversion: 2.1 time: 0.171327 Sep 15 07:40:40.270577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 94/199] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:40 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:40.308824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-dd355bfd-16d9-49f4-8fd4-d6455c2875c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:40.321129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-dd355bfd-16d9-49f4-8fd4-d6455c2875c7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1245 microversion: 2.1 time: 0.108994 Sep 15 07:40:40.322252 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 106/200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:40 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:40.726732 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:40.728197 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:40.740986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:40.741893 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:40.742354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:40.743064 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:40.743512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:40.744074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:40.901661 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:40.918388 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:40.919859 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:40.921087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-709cb52c-3a33-4872-9e22-ba5e0a826f12 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.198339 Sep 15 07:40:40.921824 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 95/201] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:40 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:40.995029 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-754f1291-df46-4113-bffa-15b12572abab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:40.995677 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-754f1291-df46-4113-bffa-15b12572abab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:40.997546 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:41.003723 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-754f1291-df46-4113-bffa-15b12572abab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:41.004215 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-754f1291-df46-4113-bffa-15b12572abab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:41.004660 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-754f1291-df46-4113-bffa-15b12572abab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:41.005368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-754f1291-df46-4113-bffa-15b12572abab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:41.005858 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-754f1291-df46-4113-bffa-15b12572abab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:41.006293 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-754f1291-df46-4113-bffa-15b12572abab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:41.156800 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-754f1291-df46-4113-bffa-15b12572abab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:41.164588 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-754f1291-df46-4113-bffa-15b12572abab tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.173511 Sep 15 07:40:41.165163 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 107/202] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:40 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:41.293930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bfe2356f-7125-4192-b08c-457d5cd9a535 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:41.294538 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bfe2356f-7125-4192-b08c-457d5cd9a535 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:41.300983 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfe2356f-7125-4192-b08c-457d5cd9a535 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:41.301459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfe2356f-7125-4192-b08c-457d5cd9a535 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:41.301932 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfe2356f-7125-4192-b08c-457d5cd9a535 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:41.302605 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfe2356f-7125-4192-b08c-457d5cd9a535 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:41.303092 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfe2356f-7125-4192-b08c-457d5cd9a535 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:41.303453 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfe2356f-7125-4192-b08c-457d5cd9a535 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:41.348944 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2ee263d7-9455-4881-8b23-023d73c1d556 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:41.350336 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2ee263d7-9455-4881-8b23-023d73c1d556 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:41.356903 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2ee263d7-9455-4881-8b23-023d73c1d556 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:41.358702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2ee263d7-9455-4881-8b23-023d73c1d556 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:41.358702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2ee263d7-9455-4881-8b23-023d73c1d556 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:41.359478 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2ee263d7-9455-4881-8b23-023d73c1d556 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:41.360136 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2ee263d7-9455-4881-8b23-023d73c1d556 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:41.360741 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2ee263d7-9455-4881-8b23-023d73c1d556 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:41.448726 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2ee263d7-9455-4881-8b23-023d73c1d556 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:41.460887 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2ee263d7-9455-4881-8b23-023d73c1d556 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1293 microversion: 2.1 time: 0.116841 Sep 15 07:40:41.461955 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 108/203] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:41 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:41.484180 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bfe2356f-7125-4192-b08c-457d5cd9a535 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:41.492820 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bfe2356f-7125-4192-b08c-457d5cd9a535 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1314 microversion: 2.1 time: 0.202478 Sep 15 07:40:41.493498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 96/204] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:41 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:41.955648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:41.956261 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:41.962792 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:41.963271 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:41.963770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:41.973787 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:41.985935 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:41.986453 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:42.191432 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:42.191981 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2df6422e-f5df-4c0d-a8d5-e63315abc452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:42.192810 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2df6422e-f5df-4c0d-a8d5-e63315abc452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:42.204111 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:42.205874 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:42.207096 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2df6422e-f5df-4c0d-a8d5-e63315abc452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:42.207448 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-70fe379d-f082-4c18-a821-bc080a4ff3c9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.262421 Sep 15 07:40:42.215317 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2df6422e-f5df-4c0d-a8d5-e63315abc452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:42.215697 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 109/205] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:41 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:42.215787 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2df6422e-f5df-4c0d-a8d5-e63315abc452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:42.216228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2df6422e-f5df-4c0d-a8d5-e63315abc452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:42.216779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2df6422e-f5df-4c0d-a8d5-e63315abc452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:42.221399 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2df6422e-f5df-4c0d-a8d5-e63315abc452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:42.242523 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-8d725e31-0d9b-484c-9efd-54a15b8afa04 req-a8f9c41c-eca4-4436-9260-a7047898c2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9614c29-883e-453c-afa9-5fd85d5e4cac", "name": "network-vif-plugged", "status": "completed", "tag": "639ec1c3-62f0-47df-8bdc-a50dd0cc3a4a"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:42.252283 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-8d725e31-0d9b-484c-9efd-54a15b8afa04 req-a8f9c41c-eca4-4436-9260-a7047898c2c4 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:42.252949 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-8d725e31-0d9b-484c-9efd-54a15b8afa04 req-a8f9c41c-eca4-4436-9260-a7047898c2c4 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:42.253374 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-8d725e31-0d9b-484c-9efd-54a15b8afa04 req-a8f9c41c-eca4-4436-9260-a7047898c2c4 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:42.265644 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-8d725e31-0d9b-484c-9efd-54a15b8afa04 req-a8f9c41c-eca4-4436-9260-a7047898c2c4 service nova] Creating event network-vif-plugged:639ec1c3-62f0-47df-8bdc-a50dd0cc3a4a for instance d9614c29-883e-453c-afa9-5fd85d5e4cac on hv-cinder-82414 Sep 15 07:40:42.271212 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-8d725e31-0d9b-484c-9efd-54a15b8afa04 req-a8f9c41c-eca4-4436-9260-a7047898c2c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032341 Sep 15 07:40:42.271889 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 110/206] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:42.395858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-2df6422e-f5df-4c0d-a8d5-e63315abc452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:42.404606 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2df6422e-f5df-4c0d-a8d5-e63315abc452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.218797 Sep 15 07:40:42.407105 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 97/207] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:42 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:42.487481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-06458c5e-25ba-4a2d-bf0b-4194bae32495 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:42.490937 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-06458c5e-25ba-4a2d-bf0b-4194bae32495 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:42.496168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06458c5e-25ba-4a2d-bf0b-4194bae32495 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:42.497020 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06458c5e-25ba-4a2d-bf0b-4194bae32495 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:42.497702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06458c5e-25ba-4a2d-bf0b-4194bae32495 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:42.498479 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06458c5e-25ba-4a2d-bf0b-4194bae32495 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:42.499343 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06458c5e-25ba-4a2d-bf0b-4194bae32495 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:42.499985 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06458c5e-25ba-4a2d-bf0b-4194bae32495 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:42.519147 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6d97afc0-14ce-4cfc-af01-95d164098223 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:42.519820 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6d97afc0-14ce-4cfc-af01-95d164098223 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:42.532694 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d97afc0-14ce-4cfc-af01-95d164098223 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:42.533436 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d97afc0-14ce-4cfc-af01-95d164098223 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:42.534232 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d97afc0-14ce-4cfc-af01-95d164098223 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:42.535081 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d97afc0-14ce-4cfc-af01-95d164098223 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:42.535688 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d97afc0-14ce-4cfc-af01-95d164098223 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:42.536428 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d97afc0-14ce-4cfc-af01-95d164098223 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:42.581022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-06458c5e-25ba-4a2d-bf0b-4194bae32495 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:42.603845 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-06458c5e-25ba-4a2d-bf0b-4194bae32495 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1299 microversion: 2.1 time: 0.123188 Sep 15 07:40:42.622999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 111/208] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:42 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:42.773893 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6d97afc0-14ce-4cfc-af01-95d164098223 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:42.783747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6d97afc0-14ce-4cfc-af01-95d164098223 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1314 microversion: 2.1 time: 0.269724 Sep 15 07:40:42.784680 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 98/209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:42 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:43.243050 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:43.247982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:43.252767 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:43.253513 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:43.254273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:43.255109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:43.255639 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:43.256191 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:43.434862 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ca614f99-ebb3-4716-b739-3540759ef1a9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:43.436119 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ca614f99-ebb3-4716-b739-3540759ef1a9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:43.443372 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ca614f99-ebb3-4716-b739-3540759ef1a9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:43.443859 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ca614f99-ebb3-4716-b739-3540759ef1a9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:43.444291 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ca614f99-ebb3-4716-b739-3540759ef1a9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:43.444981 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ca614f99-ebb3-4716-b739-3540759ef1a9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:43.445426 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ca614f99-ebb3-4716-b739-3540759ef1a9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:43.445884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ca614f99-ebb3-4716-b739-3540759ef1a9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:43.446943 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:43.451261 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:43.457991 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:43.459869 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:43.461318 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6f28b8ab-9928-445e-ade0-6692bff442c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.222223 Sep 15 07:40:43.462435 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 112/210] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:43 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:43.597530 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ca614f99-ebb3-4716-b739-3540759ef1a9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:43.605196 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ca614f99-ebb3-4716-b739-3540759ef1a9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.174142 Sep 15 07:40:43.605791 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 99/211] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:43 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:43.627933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4ce60b19-43db-4800-a906-8a42d13e2709 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:43.628556 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-4ce60b19-43db-4800-a906-8a42d13e2709 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:43.635304 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ce60b19-43db-4800-a906-8a42d13e2709 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:43.635800 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ce60b19-43db-4800-a906-8a42d13e2709 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:43.637037 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ce60b19-43db-4800-a906-8a42d13e2709 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:43.637037 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ce60b19-43db-4800-a906-8a42d13e2709 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:43.637371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ce60b19-43db-4800-a906-8a42d13e2709 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:43.638012 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ce60b19-43db-4800-a906-8a42d13e2709 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:43.798214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4ce60b19-43db-4800-a906-8a42d13e2709 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:43.807680 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-10c9f7bf-7b55-4ee0-97ac-788ca94f6bac tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:43.809164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-10c9f7bf-7b55-4ee0-97ac-788ca94f6bac tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:43.819598 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10c9f7bf-7b55-4ee0-97ac-788ca94f6bac tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:43.822022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10c9f7bf-7b55-4ee0-97ac-788ca94f6bac tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:43.823226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10c9f7bf-7b55-4ee0-97ac-788ca94f6bac tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:43.824047 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4ce60b19-43db-4800-a906-8a42d13e2709 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1367 microversion: 2.1 time: 0.199931 Sep 15 07:40:43.824925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10c9f7bf-7b55-4ee0-97ac-788ca94f6bac tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:43.825390 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10c9f7bf-7b55-4ee0-97ac-788ca94f6bac tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:43.838639 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10c9f7bf-7b55-4ee0-97ac-788ca94f6bac tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:43.843017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 113/212] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:43 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:43.859068 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:43.973751 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-10c9f7bf-7b55-4ee0-97ac-788ca94f6bac tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:43.981786 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-10c9f7bf-7b55-4ee0-97ac-788ca94f6bac tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1314 microversion: 2.1 time: 0.178837 Sep 15 07:40:43.982647 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 100/213] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:43 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:44.072441 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-fad9a513-1e47-463c-9a4a-ba40960936c9 req-836b2213-e814-4d45-96bb-fe153acae665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c6ee4c-f348-424e-9fa6-ca2ee2f67967", "tag": "3b7d0375-a226-4e4b-a78f-fde982eb4c97"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:44.082732 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-fad9a513-1e47-463c-9a4a-ba40960936c9 req-836b2213-e814-4d45-96bb-fe153acae665 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:44.083217 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-fad9a513-1e47-463c-9a4a-ba40960936c9 req-836b2213-e814-4d45-96bb-fe153acae665 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:44.083651 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-fad9a513-1e47-463c-9a4a-ba40960936c9 req-836b2213-e814-4d45-96bb-fe153acae665 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:44.094827 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-fad9a513-1e47-463c-9a4a-ba40960936c9 req-836b2213-e814-4d45-96bb-fe153acae665 service nova] Creating event network-changed:3b7d0375-a226-4e4b-a78f-fde982eb4c97 for instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 on hv-cinder-82414 Sep 15 07:40:44.099686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-fad9a513-1e47-463c-9a4a-ba40960936c9 req-836b2213-e814-4d45-96bb-fe153acae665 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031197 Sep 15 07:40:44.100292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 114/214] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:44.515874 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:44.515874 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:44.515874 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:44.515874 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:44.517046 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:44.517046 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:44.517046 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:44.517046 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:44.630648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e3265ced-e1f9-43d6-83b3-f1483f8d1af0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:44.632354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e3265ced-e1f9-43d6-83b3-f1483f8d1af0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:44.639394 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e3265ced-e1f9-43d6-83b3-f1483f8d1af0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:44.641054 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e3265ced-e1f9-43d6-83b3-f1483f8d1af0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:44.641488 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e3265ced-e1f9-43d6-83b3-f1483f8d1af0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:44.642301 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e3265ced-e1f9-43d6-83b3-f1483f8d1af0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:44.642976 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e3265ced-e1f9-43d6-83b3-f1483f8d1af0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:44.643402 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e3265ced-e1f9-43d6-83b3-f1483f8d1af0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:44.715904 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:44.725155 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:44.728321 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:44.736843 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-480776cf-b7c7-4d23-a596-46e24b296a53 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.251781 Sep 15 07:40:44.737517 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 101/215] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:44 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:44.853050 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-45004ac3-79cb-4c82-bfdc-bad8328b0bbd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:44.854894 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-45004ac3-79cb-4c82-bfdc-bad8328b0bbd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:44.871270 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45004ac3-79cb-4c82-bfdc-bad8328b0bbd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:44.873303 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45004ac3-79cb-4c82-bfdc-bad8328b0bbd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:44.873303 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45004ac3-79cb-4c82-bfdc-bad8328b0bbd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:44.874513 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45004ac3-79cb-4c82-bfdc-bad8328b0bbd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:44.875470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45004ac3-79cb-4c82-bfdc-bad8328b0bbd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:44.876091 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45004ac3-79cb-4c82-bfdc-bad8328b0bbd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:45.146090 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e3265ced-e1f9-43d6-83b3-f1483f8d1af0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:45.165571 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e3265ced-e1f9-43d6-83b3-f1483f8d1af0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.536047 Sep 15 07:40:45.165571 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 115/216] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:44 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:45.167246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3d68e558-e9da-4068-9705-a3840ec915ea tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:45.167855 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3d68e558-e9da-4068-9705-a3840ec915ea tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:45.174982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d68e558-e9da-4068-9705-a3840ec915ea tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:45.175710 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d68e558-e9da-4068-9705-a3840ec915ea tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:45.176313 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d68e558-e9da-4068-9705-a3840ec915ea tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:45.177190 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d68e558-e9da-4068-9705-a3840ec915ea tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:45.177828 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d68e558-e9da-4068-9705-a3840ec915ea tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:45.178395 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d68e558-e9da-4068-9705-a3840ec915ea tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:45.219247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-45004ac3-79cb-4c82-bfdc-bad8328b0bbd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:45.226588 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-45004ac3-79cb-4c82-bfdc-bad8328b0bbd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1367 microversion: 2.1 time: 0.378821 Sep 15 07:40:45.227191 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 102/217] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:44 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:45.391436 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3d68e558-e9da-4068-9705-a3840ec915ea tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:45.399306 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3d68e558-e9da-4068-9705-a3840ec915ea tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1464 microversion: 2.1 time: 0.235548 Sep 15 07:40:45.402510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 116/218] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:45 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1464 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:45.452562 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7830d441-f0b3-4eb2-b607-d7fb97d78eb7 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:45.453071 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7830d441-f0b3-4eb2-b607-d7fb97d78eb7 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:45.459900 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7830d441-f0b3-4eb2-b607-d7fb97d78eb7 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:45.460304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7830d441-f0b3-4eb2-b607-d7fb97d78eb7 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:45.460744 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7830d441-f0b3-4eb2-b607-d7fb97d78eb7 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:45.461446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7830d441-f0b3-4eb2-b607-d7fb97d78eb7 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:45.461930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7830d441-f0b3-4eb2-b607-d7fb97d78eb7 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:45.462576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7830d441-f0b3-4eb2-b607-d7fb97d78eb7 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:45.498233 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7830d441-f0b3-4eb2-b607-d7fb97d78eb7 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Going to try to terminate instance {{(pid=132673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:40:45.763877 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:45.765298 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:45.772889 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:45.775910 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:45.775910 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:45.775910 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:45.775910 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:45.776281 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:45.834677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7830d441-f0b3-4eb2-b607-d7fb97d78eb7 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 204 len: 0 microversion: 2.1 time: 0.385819 Sep 15 07:40:45.838841 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 103/219] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:40:45 2022] DELETE /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:40:45.844923 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-33fa1059-a0f6-4fd6-89b6-434171012c62 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:45.845645 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-33fa1059-a0f6-4fd6-89b6-434171012c62 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:45.851565 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-33fa1059-a0f6-4fd6-89b6-434171012c62 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:45.852256 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-33fa1059-a0f6-4fd6-89b6-434171012c62 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:45.852699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-33fa1059-a0f6-4fd6-89b6-434171012c62 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:45.853547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-33fa1059-a0f6-4fd6-89b6-434171012c62 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:45.867779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-33fa1059-a0f6-4fd6-89b6-434171012c62 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:45.867779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-33fa1059-a0f6-4fd6-89b6-434171012c62 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:45.964067 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:45.974520 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:45.976166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:45.977736 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b86d990f-a76e-4c1a-bc26-6814dd7913a9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1744 microversion: 2.20 time: 0.217649 Sep 15 07:40:45.978238 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 117/220] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:45 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1744 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:40:46.035377 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-33fa1059-a0f6-4fd6-89b6-434171012c62 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:46.043063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-33fa1059-a0f6-4fd6-89b6-434171012c62 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1470 microversion: 2.1 time: 0.202532 Sep 15 07:40:46.043631 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 104/221] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:45 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:46.190693 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5fce28a3-25bc-43c0-8ded-9dd4936a8760 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:46.191303 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5fce28a3-25bc-43c0-8ded-9dd4936a8760 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:46.197538 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fce28a3-25bc-43c0-8ded-9dd4936a8760 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:46.198059 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fce28a3-25bc-43c0-8ded-9dd4936a8760 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:46.198835 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fce28a3-25bc-43c0-8ded-9dd4936a8760 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:46.199202 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fce28a3-25bc-43c0-8ded-9dd4936a8760 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:46.199701 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fce28a3-25bc-43c0-8ded-9dd4936a8760 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:46.200095 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fce28a3-25bc-43c0-8ded-9dd4936a8760 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:46.260763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-792a18d0-d866-4bbb-b62b-87458b560cf1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:46.261473 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-792a18d0-d866-4bbb-b62b-87458b560cf1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:46.268853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-792a18d0-d866-4bbb-b62b-87458b560cf1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:46.275990 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-792a18d0-d866-4bbb-b62b-87458b560cf1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:46.275990 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-792a18d0-d866-4bbb-b62b-87458b560cf1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:46.275990 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-792a18d0-d866-4bbb-b62b-87458b560cf1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:46.275990 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-792a18d0-d866-4bbb-b62b-87458b560cf1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:46.276319 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-792a18d0-d866-4bbb-b62b-87458b560cf1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:46.400395 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5fce28a3-25bc-43c0-8ded-9dd4936a8760 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:46.407908 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5fce28a3-25bc-43c0-8ded-9dd4936a8760 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.221721 Sep 15 07:40:46.408695 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 118/222] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:46 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:46.449142 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-792a18d0-d866-4bbb-b62b-87458b560cf1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:46.457299 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-792a18d0-d866-4bbb-b62b-87458b560cf1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1367 microversion: 2.1 time: 0.200428 Sep 15 07:40:46.462840 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 105/223] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:46 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:47.003684 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:47.004292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:47.010818 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:47.011227 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:47.011660 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:47.012341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:47.012785 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:47.013202 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:47.067501 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-16a32b67-6a2d-49f4-9ce2-d9372ce80430 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:47.068113 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-16a32b67-6a2d-49f4-9ce2-d9372ce80430 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:47.074601 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16a32b67-6a2d-49f4-9ce2-d9372ce80430 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:47.075083 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16a32b67-6a2d-49f4-9ce2-d9372ce80430 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:47.075511 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16a32b67-6a2d-49f4-9ce2-d9372ce80430 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:47.076194 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16a32b67-6a2d-49f4-9ce2-d9372ce80430 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:47.076643 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16a32b67-6a2d-49f4-9ce2-d9372ce80430 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:47.077092 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16a32b67-6a2d-49f4-9ce2-d9372ce80430 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:47.187029 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:47.195170 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:47.196603 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:47.197794 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-8b08626b-3113-4d7e-ba9e-265b28b70501 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1744 microversion: 2.20 time: 0.198461 Sep 15 07:40:47.198353 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 119/224] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:46 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1744 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:47.231819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-16a32b67-6a2d-49f4-9ce2-d9372ce80430 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:47.244527 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-16a32b67-6a2d-49f4-9ce2-d9372ce80430 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1470 microversion: 2.1 time: 0.180788 Sep 15 07:40:47.245128 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 106/225] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:47 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:47.431314 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4390e75c-8e17-4fb4-8c2c-480cda5313e1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:47.431998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-4390e75c-8e17-4fb4-8c2c-480cda5313e1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:47.438354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4390e75c-8e17-4fb4-8c2c-480cda5313e1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:47.438842 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4390e75c-8e17-4fb4-8c2c-480cda5313e1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:47.439284 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4390e75c-8e17-4fb4-8c2c-480cda5313e1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:47.440006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4390e75c-8e17-4fb4-8c2c-480cda5313e1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:47.440462 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4390e75c-8e17-4fb4-8c2c-480cda5313e1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:47.440890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4390e75c-8e17-4fb4-8c2c-480cda5313e1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:47.479878 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bfc80568-602c-4b3f-b7c5-93e82696cec2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:47.480486 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bfc80568-602c-4b3f-b7c5-93e82696cec2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:47.490066 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfc80568-602c-4b3f-b7c5-93e82696cec2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:47.490567 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfc80568-602c-4b3f-b7c5-93e82696cec2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:47.491604 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfc80568-602c-4b3f-b7c5-93e82696cec2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:47.494100 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfc80568-602c-4b3f-b7c5-93e82696cec2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:47.499761 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfc80568-602c-4b3f-b7c5-93e82696cec2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:47.500607 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bfc80568-602c-4b3f-b7c5-93e82696cec2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:47.636619 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4390e75c-8e17-4fb4-8c2c-480cda5313e1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:47.645147 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4390e75c-8e17-4fb4-8c2c-480cda5313e1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.217651 Sep 15 07:40:47.646420 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 120/226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:47 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:47.673599 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bfc80568-602c-4b3f-b7c5-93e82696cec2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:47.681850 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bfc80568-602c-4b3f-b7c5-93e82696cec2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1367 microversion: 2.1 time: 0.205875 Sep 15 07:40:47.682434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 107/227] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:47 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:48.226164 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:48.226878 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:48.234213 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:48.234807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:48.235396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:48.236202 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:48.236927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:48.237565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:48.244726 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-8b4a0a66-ab84-4998-af01-f1d9ce73421d req-492cf05a-5e3b-410a-8bb5-4d425436df84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ae2103-9abb-45d7-94b1-7e0f83c44fa0", "name": "network-vif-plugged", "status": "completed", "tag": "60114f49-493e-46b0-a653-b05d4362ebe7"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:48.257170 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-8b4a0a66-ab84-4998-af01-f1d9ce73421d req-492cf05a-5e3b-410a-8bb5-4d425436df84 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:48.258042 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-8b4a0a66-ab84-4998-af01-f1d9ce73421d req-492cf05a-5e3b-410a-8bb5-4d425436df84 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:48.258471 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-8b4a0a66-ab84-4998-af01-f1d9ce73421d req-492cf05a-5e3b-410a-8bb5-4d425436df84 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:48.270927 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-8b4a0a66-ab84-4998-af01-f1d9ce73421d req-492cf05a-5e3b-410a-8bb5-4d425436df84 service nova] Creating event network-vif-plugged:60114f49-493e-46b0-a653-b05d4362ebe7 for instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 on hv-cinder-82414 Sep 15 07:40:48.275961 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-8b4a0a66-ab84-4998-af01-f1d9ce73421d req-492cf05a-5e3b-410a-8bb5-4d425436df84 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035708 Sep 15 07:40:48.276561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 108/228] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:48.282870 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-73077503-b4ca-4b20-97f5-afe57f6a4269 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:48.283757 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-73077503-b4ca-4b20-97f5-afe57f6a4269 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:48.290060 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73077503-b4ca-4b20-97f5-afe57f6a4269 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:48.290535 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73077503-b4ca-4b20-97f5-afe57f6a4269 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:48.298880 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73077503-b4ca-4b20-97f5-afe57f6a4269 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:48.298880 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73077503-b4ca-4b20-97f5-afe57f6a4269 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:48.298880 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73077503-b4ca-4b20-97f5-afe57f6a4269 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:48.298880 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73077503-b4ca-4b20-97f5-afe57f6a4269 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:48.419310 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:48.433058 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:48.439338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:48.440912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-8d3bcaeb-7069-49cb-ab6e-9235b2e03577 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1744 microversion: 2.20 time: 0.219159 Sep 15 07:40:48.441615 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 121/229] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:48 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:48.514177 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-73077503-b4ca-4b20-97f5-afe57f6a4269 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:48.523308 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-73077503-b4ca-4b20-97f5-afe57f6a4269 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1470 microversion: 2.1 time: 0.245352 Sep 15 07:40:48.523896 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 109/230] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:48 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:48.668890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c0f44f89-0c30-4f56-ba73-e9046f245b9a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:48.669786 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c0f44f89-0c30-4f56-ba73-e9046f245b9a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:48.676788 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c0f44f89-0c30-4f56-ba73-e9046f245b9a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:48.677282 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c0f44f89-0c30-4f56-ba73-e9046f245b9a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:48.677944 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c0f44f89-0c30-4f56-ba73-e9046f245b9a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:48.679040 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c0f44f89-0c30-4f56-ba73-e9046f245b9a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:48.679587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c0f44f89-0c30-4f56-ba73-e9046f245b9a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:48.680022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c0f44f89-0c30-4f56-ba73-e9046f245b9a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:48.704133 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d16c9fd9-3ecb-4472-987a-953b323f5565 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:48.704749 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d16c9fd9-3ecb-4472-987a-953b323f5565 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:48.715930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d16c9fd9-3ecb-4472-987a-953b323f5565 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:48.716423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d16c9fd9-3ecb-4472-987a-953b323f5565 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:48.716859 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d16c9fd9-3ecb-4472-987a-953b323f5565 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:48.717566 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d16c9fd9-3ecb-4472-987a-953b323f5565 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:48.718069 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d16c9fd9-3ecb-4472-987a-953b323f5565 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:48.718491 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d16c9fd9-3ecb-4472-987a-953b323f5565 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:48.903213 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:48.928399 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=10 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:49.004097 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d16c9fd9-3ecb-4472-987a-953b323f5565 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:49.006711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c0f44f89-0c30-4f56-ba73-e9046f245b9a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:49.014150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d16c9fd9-3ecb-4472-987a-953b323f5565 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1367 microversion: 2.1 time: 0.313574 Sep 15 07:40:49.015431 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c0f44f89-0c30-4f56-ba73-e9046f245b9a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.349576 Sep 15 07:40:49.016906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 122/231] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:48 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:49.023111 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 110/232] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:48 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:49.253644 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-c4387402-3a00-4196-b781-692596953397 req-f387914d-8071-4949-8a5e-4a1497c40efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9614c29-883e-453c-afa9-5fd85d5e4cac", "name": "network-vif-deleted", "tag": "639ec1c3-62f0-47df-8bdc-a50dd0cc3a4a"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:49.259272 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=12 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:49.266475 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-c4387402-3a00-4196-b781-692596953397 req-f387914d-8071-4949-8a5e-4a1497c40efa service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:49.266926 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-c4387402-3a00-4196-b781-692596953397 req-f387914d-8071-4949-8a5e-4a1497c40efa service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:49.267359 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-c4387402-3a00-4196-b781-692596953397 req-f387914d-8071-4949-8a5e-4a1497c40efa service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:49.279694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-c4387402-3a00-4196-b781-692596953397 req-f387914d-8071-4949-8a5e-4a1497c40efa service nova] Creating event network-vif-deleted:639ec1c3-62f0-47df-8bdc-a50dd0cc3a4a for instance d9614c29-883e-453c-afa9-5fd85d5e4cac on hv-cinder-82414 Sep 15 07:40:49.285313 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-c4387402-3a00-4196-b781-692596953397 req-f387914d-8071-4949-8a5e-4a1497c40efa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036243 Sep 15 07:40:49.286394 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 123/233] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:49.470331 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:49.473840 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:49.482579 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:49.483063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:49.484109 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:49.484918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:49.485370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:49.485821 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:49.555379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:49.556193 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:49.564772 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:49.565510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:49.568550 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:49.570715 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:49.573242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:49.574055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:49.619405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:49.620124 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:49.620563 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:49.621010 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lazy-loading 'fault' on Instance uuid d9614c29-883e-453c-afa9-5fd85d5e4cac {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:40:49.682133 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:49.683977 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e55686994a4e6b86096cc21c52085d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0730e401f844b55a78df53dba8e4b5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:49.692997 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:49.693275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d695a5c5-9d22-4e87-9e47-4b6920de5a3b tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 200 len: 1304 microversion: 2.1 time: 0.144076 Sep 15 07:40:49.694060 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 124/234] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:49 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:49.694656 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:49.696241 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d565a3d4-a59e-40d7-b060-34f5e95085d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.232721 Sep 15 07:40:49.722197 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 111/235] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:49 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:50.040333 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2b689aaa-ace6-4638-ab2e-1a789634c6f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:50.041209 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2b689aaa-ace6-4638-ab2e-1a789634c6f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:50.049244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2b689aaa-ace6-4638-ab2e-1a789634c6f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:50.050100 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2b689aaa-ace6-4638-ab2e-1a789634c6f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:50.050225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-215b0c02-a68a-4649-8654-0e357a94d410 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:50.050798 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-215b0c02-a68a-4649-8654-0e357a94d410 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:50.051941 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2b689aaa-ace6-4638-ab2e-1a789634c6f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:50.051941 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2b689aaa-ace6-4638-ab2e-1a789634c6f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:50.052678 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2b689aaa-ace6-4638-ab2e-1a789634c6f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:50.053333 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2b689aaa-ace6-4638-ab2e-1a789634c6f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:50.059235 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-215b0c02-a68a-4649-8654-0e357a94d410 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:50.061675 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-215b0c02-a68a-4649-8654-0e357a94d410 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:50.062330 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-215b0c02-a68a-4649-8654-0e357a94d410 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:50.063760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-215b0c02-a68a-4649-8654-0e357a94d410 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:50.064370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-215b0c02-a68a-4649-8654-0e357a94d410 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:50.064946 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-215b0c02-a68a-4649-8654-0e357a94d410 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:50.318589 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-215b0c02-a68a-4649-8654-0e357a94d410 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:50.328780 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-215b0c02-a68a-4649-8654-0e357a94d410 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1367 microversion: 2.1 time: 0.283789 Sep 15 07:40:50.335411 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 112/236] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:50 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:50.366764 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2b689aaa-ace6-4638-ab2e-1a789634c6f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:50.383975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2b689aaa-ace6-4638-ab2e-1a789634c6f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.347713 Sep 15 07:40:50.384823 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 125/237] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:50 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:50.729933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:50.730621 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:50.731487 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] [instance: d9614c29-883e-453c-afa9-5fd85d5e4cac] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:50.731708 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:50.748805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:50.752337 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:50.752695 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:50.754186 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:50.754601 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:50.755992 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:50.756598 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:50.757245 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:50.759021 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:50.759299 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:50.772538 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:50.776051 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:50.844400 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] HTTP exception thrown: Instance d9614c29-883e-453c-afa9-5fd85d5e4cac could not be found. Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Request method failure captured: Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac HTTP/1.1 Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItbqAnudnBrT9okx2EnDa3SlXoGDBTzAI9LQ7p4orObbLeBtWZC_mVDQLcEmt5YzlWAjtLDacvZgw2nePtzyrK1YSvSwwp6rPcVg8JFg_wSlInWrSZYwH4Wgr5Y_RIHlxX8E3lAsFiOw2ZLOUuT-QwXAIuc_HVnXIoO-fOxo1aK2y1M Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: e0730e401f844b55a78df53dba8e4b5c Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-VolumesNegativeTest-1244463079 Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:40:50.846362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e0730e401f844b55a78df53dba8e4b5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e0730e401f844b55a78df53dba8e4b5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e0730e401f844b55a78df53dba8e4b5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e0730e401f844b55a78df53dba8e4b5c"}]}] Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-VolumesNegativeTest-1244463079 Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: e0730e401f844b55a78df53dba8e4b5c Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-VolumesNegativeTest-1244463079 Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-VolumesNegativeTest-1244463079-project Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 82e55686994a4e6b86096cc21c52085d Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-VolumesNegativeTest-1244463079-project Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance d9614c29-883e-453c-afa9-5fd85d5e4cac could not be found. Sep 15 07:40:50.847952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': 'd9614c29-883e-453c-afa9-5fd85d5e4cac'} Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9614c29-883e-453c-afa9-5fd85d5e4cac could not be found. Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:40:50.848907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9614c29-883e-453c-afa9-5fd85d5e4cac could not be found. Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9614c29-883e-453c-afa9-5fd85d5e4cac could not be found. Sep 15 07:40:50.850406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:40:50.851872 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] Returning 404 to user: Instance d9614c29-883e-453c-afa9-5fd85d5e4cac could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:40:50.852937 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9a057894-c458-445f-8272-5d8c70861733 tempest-VolumesNegativeTest-1244463079 tempest-VolumesNegativeTest-1244463079-project] 10.222.0.42 "GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac" status: 404 len: 111 microversion: 2.1 time: 0.126753 Sep 15 07:40:50.854083 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 113/238] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:50 2022] GET /compute/v2.1/servers/d9614c29-883e-453c-afa9-5fd85d5e4cac => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:40:51.010551 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:51.025047 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:51.026551 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:51.027928 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a0e8a486-bf45-4f4c-9463-e54b5e614650 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.302218 Sep 15 07:40:51.028802 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 126/239] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:50 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:51.357970 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8d3388f8-b923-4ce5-a301-2fe1e9f922da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:51.359790 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8d3388f8-b923-4ce5-a301-2fe1e9f922da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:51.373053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8d3388f8-b923-4ce5-a301-2fe1e9f922da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:51.373972 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8d3388f8-b923-4ce5-a301-2fe1e9f922da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:51.374918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8d3388f8-b923-4ce5-a301-2fe1e9f922da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:51.375880 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8d3388f8-b923-4ce5-a301-2fe1e9f922da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:51.376662 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8d3388f8-b923-4ce5-a301-2fe1e9f922da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:51.377751 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8d3388f8-b923-4ce5-a301-2fe1e9f922da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:51.420775 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b406e36f-e6e5-4585-83db-0e0c5920c391 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:51.425486 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b406e36f-e6e5-4585-83db-0e0c5920c391 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:51.443225 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b406e36f-e6e5-4585-83db-0e0c5920c391 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:51.444066 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b406e36f-e6e5-4585-83db-0e0c5920c391 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:51.454002 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b406e36f-e6e5-4585-83db-0e0c5920c391 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:51.457276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b406e36f-e6e5-4585-83db-0e0c5920c391 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:51.457276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b406e36f-e6e5-4585-83db-0e0c5920c391 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:51.457276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b406e36f-e6e5-4585-83db-0e0c5920c391 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:51.658806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8d3388f8-b923-4ce5-a301-2fe1e9f922da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:51.672647 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8d3388f8-b923-4ce5-a301-2fe1e9f922da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1367 microversion: 2.1 time: 0.319253 Sep 15 07:40:51.674087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 114/240] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:51 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:51.728404 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b406e36f-e6e5-4585-83db-0e0c5920c391 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:51.742140 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b406e36f-e6e5-4585-83db-0e0c5920c391 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.331264 Sep 15 07:40:51.743481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 127/241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:51 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:52.073571 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:52.074541 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:52.084070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:52.085077 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:52.085991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:52.087057 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:52.087977 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:52.088839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:52.341211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:52.355455 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-4fb9da90-4350-4aaf-88d5-7bbfcbb047aa req-050c46c6-8a92-47f2-957f-bb8d06a96ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c6ee4c-f348-424e-9fa6-ca2ee2f67967", "name": "network-vif-plugged", "status": "completed", "tag": "3b7d0375-a226-4e4b-a78f-fde982eb4c97"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:52.366142 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:52.367170 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4fb9da90-4350-4aaf-88d5-7bbfcbb047aa req-050c46c6-8a92-47f2-957f-bb8d06a96ade service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:52.367811 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4fb9da90-4350-4aaf-88d5-7bbfcbb047aa req-050c46c6-8a92-47f2-957f-bb8d06a96ade service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:52.368398 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4fb9da90-4350-4aaf-88d5-7bbfcbb047aa req-050c46c6-8a92-47f2-957f-bb8d06a96ade service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:52.370327 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:52.382589 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f6f0aee5-e8c9-48e9-a9b4-5534bbab0a85 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.329552 Sep 15 07:40:52.386164 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-4fb9da90-4350-4aaf-88d5-7bbfcbb047aa req-050c46c6-8a92-47f2-957f-bb8d06a96ade service nova] Creating event network-vif-plugged:3b7d0375-a226-4e4b-a78f-fde982eb4c97 for instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 on hv-cinder-82414 Sep 15 07:40:52.391892 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-4fb9da90-4350-4aaf-88d5-7bbfcbb047aa req-050c46c6-8a92-47f2-957f-bb8d06a96ade service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043973 Sep 15 07:40:52.393956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 128/242] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:52.394647 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 115/243] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:52 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:40:52.701145 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c709f79e-583c-46eb-9e43-72266f1d900d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:52.702314 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c709f79e-583c-46eb-9e43-72266f1d900d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:52.710626 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c709f79e-583c-46eb-9e43-72266f1d900d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:52.718247 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c709f79e-583c-46eb-9e43-72266f1d900d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:52.720975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c709f79e-583c-46eb-9e43-72266f1d900d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:52.721768 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c709f79e-583c-46eb-9e43-72266f1d900d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:52.722236 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c709f79e-583c-46eb-9e43-72266f1d900d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:52.722668 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c709f79e-583c-46eb-9e43-72266f1d900d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:52.769076 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-38db58f5-66cc-4482-83d4-42b45aa9781e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:52.769711 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-38db58f5-66cc-4482-83d4-42b45aa9781e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:52.778941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38db58f5-66cc-4482-83d4-42b45aa9781e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:52.783016 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38db58f5-66cc-4482-83d4-42b45aa9781e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:52.815878 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38db58f5-66cc-4482-83d4-42b45aa9781e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:52.817520 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38db58f5-66cc-4482-83d4-42b45aa9781e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:52.818566 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38db58f5-66cc-4482-83d4-42b45aa9781e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:52.822915 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38db58f5-66cc-4482-83d4-42b45aa9781e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:53.053725 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c709f79e-583c-46eb-9e43-72266f1d900d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:53.062543 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c709f79e-583c-46eb-9e43-72266f1d900d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1367 microversion: 2.1 time: 0.366253 Sep 15 07:40:53.063367 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 129/244] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:52 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:53.130529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-38db58f5-66cc-4482-83d4-42b45aa9781e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:53.134701 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:53.141662 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-38db58f5-66cc-4482-83d4-42b45aa9781e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.377485 Sep 15 07:40:53.142503 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 116/245] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:52 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:53.422175 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:53.423147 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:53.435363 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:53.435363 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:53.435363 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:53.435363 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:53.435989 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:53.435989 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:53.635398 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:53.647200 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:53.648786 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:53.650070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0a57f514-5966-41ce-a193-36a62998f962 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.233703 Sep 15 07:40:53.650826 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 130/246] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:53 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:53.753909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1183992622", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "networks": [{"uuid": "f394ac71-7474-4bf4-a880-a8c13e331ffa"}]}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:54.089963 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b37166c6-5259-4696-9c1f-44313e1ea27d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:54.090628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b37166c6-5259-4696-9c1f-44313e1ea27d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:54.097973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b37166c6-5259-4696-9c1f-44313e1ea27d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:54.098833 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b37166c6-5259-4696-9c1f-44313e1ea27d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:54.099396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b37166c6-5259-4696-9c1f-44313e1ea27d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:54.100471 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b37166c6-5259-4696-9c1f-44313e1ea27d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:54.101292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b37166c6-5259-4696-9c1f-44313e1ea27d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:54.102193 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b37166c6-5259-4696-9c1f-44313e1ea27d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:54.107535 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:40:54.269792 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] validate_networks() for [('f394ac71-7474-4bf4-a880-a8c13e331ffa', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:40:54.304648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b37166c6-5259-4696-9c1f-44313e1ea27d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:54.316806 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b37166c6-5259-4696-9c1f-44313e1ea27d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1367 microversion: 2.1 time: 0.230667 Sep 15 07:40:54.318581 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 131/247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:54 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:54.326622 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bd01e1e0-a5ef-4c72-835d-c8bcd9930f28 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:54.327629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bd01e1e0-a5ef-4c72-835d-c8bcd9930f28 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:54.338176 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd01e1e0-a5ef-4c72-835d-c8bcd9930f28 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:54.338971 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd01e1e0-a5ef-4c72-835d-c8bcd9930f28 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:54.339432 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd01e1e0-a5ef-4c72-835d-c8bcd9930f28 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:54.340151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd01e1e0-a5ef-4c72-835d-c8bcd9930f28 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:54.340640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd01e1e0-a5ef-4c72-835d-c8bcd9930f28 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:54.341048 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd01e1e0-a5ef-4c72-835d-c8bcd9930f28 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:54.671047 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bd01e1e0-a5ef-4c72-835d-c8bcd9930f28 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:54.682185 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bd01e1e0-a5ef-4c72-835d-c8bcd9930f28 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.362087 Sep 15 07:40:54.683055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 132/248] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:54 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:54.699275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:54.700372 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:54.724895 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:54.735132 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:54.737173 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:54.747259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:54.747259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:54.747259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:55.027577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:40:55.028008 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:40:55.028482 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:40:55.029484 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:40:55.030220 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:40:55.044263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:55.044749 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:55.045521 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:55.046892 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:55.047360 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:55.047792 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:55.101199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Getting quotas for project 66cb9c7c7eb24e30bf89b3680c713472. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:40:55.102041 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:55.106054 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Getting quotas for user ae7e3a9a28134a28a3f8f30d4b0fcb8c and project 66cb9c7c7eb24e30bf89b3680c713472. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:40:55.112866 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:55.114789 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:55.116430 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-dd76305b-a4ad-4833-a6dc-80403c222512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.421240 Sep 15 07:40:55.120051 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:40:55.124971 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:40:55.127025 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 133/249] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:54 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:55.286052 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-1e407620-457c-447f-9034-bb6e7602a733 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.536744 Sep 15 07:40:55.287817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 117/250] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:40:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:40:55.300624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1d539ab4-e0cf-4f47-a905-cf3636a9e5ad tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:55.301464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1d539ab4-e0cf-4f47-a905-cf3636a9e5ad tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:55.340301 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-50d5c954-7470-42c0-9855-c84367c2b4a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:55.340989 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-50d5c954-7470-42c0-9855-c84367c2b4a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:55.358525 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50d5c954-7470-42c0-9855-c84367c2b4a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:55.361104 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50d5c954-7470-42c0-9855-c84367c2b4a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:55.362469 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50d5c954-7470-42c0-9855-c84367c2b4a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:55.363739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50d5c954-7470-42c0-9855-c84367c2b4a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:55.367048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50d5c954-7470-42c0-9855-c84367c2b4a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:55.367599 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50d5c954-7470-42c0-9855-c84367c2b4a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:55.400946 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1d539ab4-e0cf-4f47-a905-cf3636a9e5ad tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:55.410451 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1d539ab4-e0cf-4f47-a905-cf3636a9e5ad tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1219 microversion: 2.1 time: 0.115040 Sep 15 07:40:55.411876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 134/251] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:55 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:55.575943 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-50d5c954-7470-42c0-9855-c84367c2b4a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:55.586566 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-50d5c954-7470-42c0-9855-c84367c2b4a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1557 microversion: 2.1 time: 0.250180 Sep 15 07:40:55.587247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 118/252] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:55 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1557 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:55.611670 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a3d16762-6fc1-46be-b688-4ad96635e861 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:55.612551 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a3d16762-6fc1-46be-b688-4ad96635e861 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:55.618986 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3d16762-6fc1-46be-b688-4ad96635e861 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:55.620084 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3d16762-6fc1-46be-b688-4ad96635e861 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:55.620084 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3d16762-6fc1-46be-b688-4ad96635e861 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:55.620900 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3d16762-6fc1-46be-b688-4ad96635e861 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:55.621396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3d16762-6fc1-46be-b688-4ad96635e861 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:55.621811 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3d16762-6fc1-46be-b688-4ad96635e861 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:55.706889 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f9f94733-7108-468e-9366-176757b176c3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:55.707731 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f9f94733-7108-468e-9366-176757b176c3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:55.714638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f9f94733-7108-468e-9366-176757b176c3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:55.719135 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f9f94733-7108-468e-9366-176757b176c3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:55.719135 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f9f94733-7108-468e-9366-176757b176c3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:55.719135 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f9f94733-7108-468e-9366-176757b176c3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:55.719135 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f9f94733-7108-468e-9366-176757b176c3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:55.720363 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f9f94733-7108-468e-9366-176757b176c3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:55.720458 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a3d16762-6fc1-46be-b688-4ad96635e861 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112950 Sep 15 07:40:55.721506 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 135/253] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 15 07:40:55 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:55.891344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f9f94733-7108-468e-9366-176757b176c3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:55.902049 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f9f94733-7108-468e-9366-176757b176c3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.198529 Sep 15 07:40:55.903454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 119/254] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:55 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:56.144873 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:56.145502 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:56.155105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:56.158603 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:56.159514 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:56.162326 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:56.162964 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:56.163680 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:56.434882 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e12b3be3-1f21-4f90-91fa-0ebb5ad0d173 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:56.434882 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e12b3be3-1f21-4f90-91fa-0ebb5ad0d173 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:56.486912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:56.505139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:56.506726 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:56.511750 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bef0126b-2162-447b-8753-290e17d41f44 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.371904 Sep 15 07:40:56.515928 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 136/255] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:56 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:56.588452 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e12b3be3-1f21-4f90-91fa-0ebb5ad0d173 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:56.599000 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e12b3be3-1f21-4f90-91fa-0ebb5ad0d173 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1219 microversion: 2.1 time: 0.169058 Sep 15 07:40:56.609520 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 120/256] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:56 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1219 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:56.931509 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ab7455dc-6cd5-4ac5-8802-dc507ffa2a8a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:56.932427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ab7455dc-6cd5-4ac5-8802-dc507ffa2a8a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:56.944338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ab7455dc-6cd5-4ac5-8802-dc507ffa2a8a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:56.944918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ab7455dc-6cd5-4ac5-8802-dc507ffa2a8a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:56.945412 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ab7455dc-6cd5-4ac5-8802-dc507ffa2a8a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:56.946249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ab7455dc-6cd5-4ac5-8802-dc507ffa2a8a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:56.948662 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ab7455dc-6cd5-4ac5-8802-dc507ffa2a8a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:56.949195 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ab7455dc-6cd5-4ac5-8802-dc507ffa2a8a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:57.147614 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ab7455dc-6cd5-4ac5-8802-dc507ffa2a8a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:57.157261 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ab7455dc-6cd5-4ac5-8802-dc507ffa2a8a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.229444 Sep 15 07:40:57.159667 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 137/257] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:56 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:57.544031 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:57.544031 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:57.554870 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:57.556643 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:57.557234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:57.558297 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:57.558899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:57.559475 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:57.623954 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e8c48dec-d3d4-4a26-8ee3-f7775183bea0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:57.625393 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e8c48dec-d3d4-4a26-8ee3-f7775183bea0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:57.642995 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e8c48dec-d3d4-4a26-8ee3-f7775183bea0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:57.643914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e8c48dec-d3d4-4a26-8ee3-f7775183bea0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:57.644554 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e8c48dec-d3d4-4a26-8ee3-f7775183bea0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:57.645698 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e8c48dec-d3d4-4a26-8ee3-f7775183bea0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:57.646360 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e8c48dec-d3d4-4a26-8ee3-f7775183bea0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:57.649057 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e8c48dec-d3d4-4a26-8ee3-f7775183bea0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:57.808873 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e8c48dec-d3d4-4a26-8ee3-f7775183bea0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:57.852477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e8c48dec-d3d4-4a26-8ee3-f7775183bea0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1271 microversion: 2.1 time: 0.232934 Sep 15 07:40:57.863312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 138/258] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:57 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:40:57.885123 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-90eaa872-1670-40f1-827c-d747c5475a7c req-27a2a9d6-cdf4-4235-9779-5786c6fc7afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c6ee4c-f348-424e-9fa6-ca2ee2f67967", "tag": "3b7d0375-a226-4e4b-a78f-fde982eb4c97"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:40:57.919913 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-90eaa872-1670-40f1-827c-d747c5475a7c req-27a2a9d6-cdf4-4235-9779-5786c6fc7afc service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:57.919913 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-90eaa872-1670-40f1-827c-d747c5475a7c req-27a2a9d6-cdf4-4235-9779-5786c6fc7afc service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:57.920201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-90eaa872-1670-40f1-827c-d747c5475a7c req-27a2a9d6-cdf4-4235-9779-5786c6fc7afc service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:57.966676 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:57.991254 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-90eaa872-1670-40f1-827c-d747c5475a7c req-27a2a9d6-cdf4-4235-9779-5786c6fc7afc service nova] Creating event network-changed:3b7d0375-a226-4e4b-a78f-fde982eb4c97 for instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 on hv-cinder-82414 Sep 15 07:40:58.001839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:58.004574 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:58.007172 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ef1d4ecf-7186-4861-b650-0a3548472825 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.467887 Sep 15 07:40:58.009348 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-90eaa872-1670-40f1-827c-d747c5475a7c req-27a2a9d6-cdf4-4235-9779-5786c6fc7afc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144373 Sep 15 07:40:58.009999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 121/259] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:57 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:40:58.010534 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 139/260] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:40:58.184017 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-41a2917c-30bf-4736-aa63-e8d6ee0f0d4c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:58.185401 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-41a2917c-30bf-4736-aa63-e8d6ee0f0d4c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:58.195228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41a2917c-30bf-4736-aa63-e8d6ee0f0d4c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:58.196348 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41a2917c-30bf-4736-aa63-e8d6ee0f0d4c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:58.197019 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41a2917c-30bf-4736-aa63-e8d6ee0f0d4c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:58.198156 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41a2917c-30bf-4736-aa63-e8d6ee0f0d4c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:58.199078 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41a2917c-30bf-4736-aa63-e8d6ee0f0d4c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:58.199738 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41a2917c-30bf-4736-aa63-e8d6ee0f0d4c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:58.438729 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-41a2917c-30bf-4736-aa63-e8d6ee0f0d4c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:58.446509 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-41a2917c-30bf-4736-aa63-e8d6ee0f0d4c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.269629 Sep 15 07:40:58.447420 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 122/261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:58 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:58.885223 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-40adf39d-9e12-47d0-a22d-eccc91f04a5e tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:58.886582 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-40adf39d-9e12-47d0-a22d-eccc91f04a5e tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:58.898280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40adf39d-9e12-47d0-a22d-eccc91f04a5e tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:58.898776 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40adf39d-9e12-47d0-a22d-eccc91f04a5e tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:58.899213 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40adf39d-9e12-47d0-a22d-eccc91f04a5e tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:58.900063 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40adf39d-9e12-47d0-a22d-eccc91f04a5e tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:58.900364 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40adf39d-9e12-47d0-a22d-eccc91f04a5e tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:58.900792 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40adf39d-9e12-47d0-a22d-eccc91f04a5e tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:59.070582 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-40adf39d-9e12-47d0-a22d-eccc91f04a5e tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:59.082909 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-40adf39d-9e12-47d0-a22d-eccc91f04a5e tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1279 microversion: 2.1 time: 0.202559 Sep 15 07:40:59.085635 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 140/262] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:58 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1279 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:40:59.155634 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:59.157070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:59.164831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:59.167263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:59.169247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:59.172823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:59.173888 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:59.174520 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:59.411547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:59.429419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:59.433495 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:59.435585 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3bbef69d-0e07-475e-9633-750fff28de00 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.283906 Sep 15 07:40:59.436696 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 123/263] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:40:59 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:40:59.471620 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9aef843f-b452-4047-b72b-df58b384ef3b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:40:59.472568 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9aef843f-b452-4047-b72b-df58b384ef3b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:40:59.490029 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9aef843f-b452-4047-b72b-df58b384ef3b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:59.490817 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9aef843f-b452-4047-b72b-df58b384ef3b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:59.492056 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9aef843f-b452-4047-b72b-df58b384ef3b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:59.492954 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9aef843f-b452-4047-b72b-df58b384ef3b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:40:59.493906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9aef843f-b452-4047-b72b-df58b384ef3b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:40:59.494488 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9aef843f-b452-4047-b72b-df58b384ef3b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:40:59.675394 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9aef843f-b452-4047-b72b-df58b384ef3b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:40:59.690641 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9aef843f-b452-4047-b72b-df58b384ef3b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.223296 Sep 15 07:40:59.692079 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 141/264] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:40:59 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:00.111991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6151323e-a6d3-4376-9286-02262d56a046 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:00.111991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6151323e-a6d3-4376-9286-02262d56a046 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:00.118121 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6151323e-a6d3-4376-9286-02262d56a046 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:00.118892 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6151323e-a6d3-4376-9286-02262d56a046 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:00.119542 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6151323e-a6d3-4376-9286-02262d56a046 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:00.120318 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6151323e-a6d3-4376-9286-02262d56a046 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:00.120868 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6151323e-a6d3-4376-9286-02262d56a046 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:00.121377 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6151323e-a6d3-4376-9286-02262d56a046 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:00.314020 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6151323e-a6d3-4376-9286-02262d56a046 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:00.322839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6151323e-a6d3-4376-9286-02262d56a046 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1319 microversion: 2.1 time: 0.216412 Sep 15 07:41:00.323796 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 124/265] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:00 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:00.464351 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:00.465753 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:00.480612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:00.481154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:00.481643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:00.482365 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:00.484792 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:00.485423 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:00.689352 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:00.700945 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:00.704400 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:00.704400 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-af2e576a-837f-4172-a275-e80a8325c8c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.246308 Sep 15 07:41:00.705269 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 142/266] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:00 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:00.713866 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b1fa34b3-456a-4625-bbfd-dc0146f479c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:00.714853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b1fa34b3-456a-4625-bbfd-dc0146f479c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:00.721747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1fa34b3-456a-4625-bbfd-dc0146f479c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:00.722529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1fa34b3-456a-4625-bbfd-dc0146f479c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:00.723202 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1fa34b3-456a-4625-bbfd-dc0146f479c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:00.724330 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1fa34b3-456a-4625-bbfd-dc0146f479c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:00.725025 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1fa34b3-456a-4625-bbfd-dc0146f479c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:00.727195 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1fa34b3-456a-4625-bbfd-dc0146f479c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:00.904199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b1fa34b3-456a-4625-bbfd-dc0146f479c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:00.913025 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b1fa34b3-456a-4625-bbfd-dc0146f479c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.202991 Sep 15 07:41:00.926824 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 125/267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:00 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:01.352197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1e8e98c3-849e-4f70-8c49-accfaec22a18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:01.352798 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1e8e98c3-849e-4f70-8c49-accfaec22a18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:01.361268 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1e8e98c3-849e-4f70-8c49-accfaec22a18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:01.361791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1e8e98c3-849e-4f70-8c49-accfaec22a18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:01.362220 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1e8e98c3-849e-4f70-8c49-accfaec22a18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:01.362926 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1e8e98c3-849e-4f70-8c49-accfaec22a18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:01.363372 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1e8e98c3-849e-4f70-8c49-accfaec22a18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:01.363979 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1e8e98c3-849e-4f70-8c49-accfaec22a18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:01.543102 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1e8e98c3-849e-4f70-8c49-accfaec22a18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:01.554221 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1e8e98c3-849e-4f70-8c49-accfaec22a18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1319 microversion: 2.1 time: 0.205799 Sep 15 07:41:01.555311 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 143/268] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:01 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:01.736193 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:01.736810 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:01.745249 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:01.747104 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:01.752739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:01.754170 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:01.754746 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:01.755387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:01.937291 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-838eb4d4-19d9-4d71-afb7-0904cfe5f58a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:01.938669 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-838eb4d4-19d9-4d71-afb7-0904cfe5f58a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:01.952814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-838eb4d4-19d9-4d71-afb7-0904cfe5f58a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:01.953676 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-838eb4d4-19d9-4d71-afb7-0904cfe5f58a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:01.954510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-838eb4d4-19d9-4d71-afb7-0904cfe5f58a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:01.956065 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-838eb4d4-19d9-4d71-afb7-0904cfe5f58a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:01.956752 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-838eb4d4-19d9-4d71-afb7-0904cfe5f58a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:01.957259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-838eb4d4-19d9-4d71-afb7-0904cfe5f58a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:01.958577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:01.967979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:01.972372 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:01.973946 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0986066e-130f-4208-9434-446c208f6886 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.243038 Sep 15 07:41:01.993415 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 126/269] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:01 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:02.138083 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-838eb4d4-19d9-4d71-afb7-0904cfe5f58a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:02.151899 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-838eb4d4-19d9-4d71-afb7-0904cfe5f58a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.219448 Sep 15 07:41:02.154938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 144/270] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:01 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:02.582114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-01d95015-3b04-4c61-a570-06b7e7897842 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:02.582775 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-01d95015-3b04-4c61-a570-06b7e7897842 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:02.585677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:02.591651 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01d95015-3b04-4c61-a570-06b7e7897842 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:02.592130 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01d95015-3b04-4c61-a570-06b7e7897842 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:02.592564 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01d95015-3b04-4c61-a570-06b7e7897842 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:02.593257 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01d95015-3b04-4c61-a570-06b7e7897842 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:02.594256 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01d95015-3b04-4c61-a570-06b7e7897842 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:02.594681 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01d95015-3b04-4c61-a570-06b7e7897842 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:02.733785 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-01d95015-3b04-4c61-a570-06b7e7897842 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:02.742262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-01d95015-3b04-4c61-a570-06b7e7897842 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1319 microversion: 2.1 time: 0.166402 Sep 15 07:41:02.743017 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 127/271] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:02 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:03.002744 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:03.005247 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:03.017678 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:03.018913 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:03.019593 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:03.020525 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:03.021322 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:03.022035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:03.187387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-38ab4e37-31a2-4762-8d33-ef5282231de3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:03.188017 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-38ab4e37-31a2-4762-8d33-ef5282231de3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:03.198434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38ab4e37-31a2-4762-8d33-ef5282231de3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:03.202467 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38ab4e37-31a2-4762-8d33-ef5282231de3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:03.202467 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38ab4e37-31a2-4762-8d33-ef5282231de3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:03.202467 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38ab4e37-31a2-4762-8d33-ef5282231de3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:03.202467 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38ab4e37-31a2-4762-8d33-ef5282231de3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:03.203561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-38ab4e37-31a2-4762-8d33-ef5282231de3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:03.207966 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:03.221814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:03.221814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:03.221814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1c0a97c4-6044-46f3-9eff-cf77dc325ee3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.224232 Sep 15 07:41:03.235011 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 145/272] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:02 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:03.382363 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-38ab4e37-31a2-4762-8d33-ef5282231de3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:03.397204 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-38ab4e37-31a2-4762-8d33-ef5282231de3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.208691 Sep 15 07:41:03.408510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-5b0e4c06-5592-4229-983d-0c370b6c544f req-6284eaff-34c3-47f3-92c9-ec219e29bd36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417dfb32-7368-4c35-8631-f0ca8b7e2680", "tag": "5f558303-6561-42ea-8bcc-d87ad98fc906"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:03.419736 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 128/273] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:03 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:03.429927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-5b0e4c06-5592-4229-983d-0c370b6c544f req-6284eaff-34c3-47f3-92c9-ec219e29bd36 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:03.430840 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-5b0e4c06-5592-4229-983d-0c370b6c544f req-6284eaff-34c3-47f3-92c9-ec219e29bd36 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:03.431936 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-5b0e4c06-5592-4229-983d-0c370b6c544f req-6284eaff-34c3-47f3-92c9-ec219e29bd36 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:03.484059 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-5b0e4c06-5592-4229-983d-0c370b6c544f req-6284eaff-34c3-47f3-92c9-ec219e29bd36 service nova] Creating event network-changed:5f558303-6561-42ea-8bcc-d87ad98fc906 for instance 417dfb32-7368-4c35-8631-f0ca8b7e2680 on hv-cinder-82414 Sep 15 07:41:03.501359 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-5b0e4c06-5592-4229-983d-0c370b6c544f req-6284eaff-34c3-47f3-92c9-ec219e29bd36 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104261 Sep 15 07:41:03.502552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 146/274] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:41:03.767929 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c8d938d5-be3a-4cb7-a8e3-ac440032c4a4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:03.768677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c8d938d5-be3a-4cb7-a8e3-ac440032c4a4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:03.774897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8d938d5-be3a-4cb7-a8e3-ac440032c4a4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:03.775464 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8d938d5-be3a-4cb7-a8e3-ac440032c4a4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:03.775908 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8d938d5-be3a-4cb7-a8e3-ac440032c4a4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:03.776611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8d938d5-be3a-4cb7-a8e3-ac440032c4a4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:03.777070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8d938d5-be3a-4cb7-a8e3-ac440032c4a4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:03.777499 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8d938d5-be3a-4cb7-a8e3-ac440032c4a4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:04.249020 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:04.249803 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:04.257049 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:04.257530 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:04.257993 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:04.258693 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:04.259150 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:04.259577 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:04.346102 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c8d938d5-be3a-4cb7-a8e3-ac440032c4a4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:04.354054 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c8d938d5-be3a-4cb7-a8e3-ac440032c4a4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1319 microversion: 2.1 time: 0.591123 Sep 15 07:41:04.354639 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 129/275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:03 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1319 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:04.416057 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e832d23e-a4ca-46aa-a9ef-c732d85ce2ac tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:04.416257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:04.416543 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e832d23e-a4ca-46aa-a9ef-c732d85ce2ac tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:04.423124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e832d23e-a4ca-46aa-a9ef-c732d85ce2ac tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:04.423619 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e832d23e-a4ca-46aa-a9ef-c732d85ce2ac tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:04.424055 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e832d23e-a4ca-46aa-a9ef-c732d85ce2ac tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:04.424618 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:04.424758 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e832d23e-a4ca-46aa-a9ef-c732d85ce2ac tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:04.425215 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e832d23e-a4ca-46aa-a9ef-c732d85ce2ac tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:04.425737 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e832d23e-a4ca-46aa-a9ef-c732d85ce2ac tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:04.426095 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:04.427264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d5d0c78c-3d1f-4d6d-8aa4-062899a529d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.182637 Sep 15 07:41:04.427821 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 147/276] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:04 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:04.570664 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e832d23e-a4ca-46aa-a9ef-c732d85ce2ac tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:04.578873 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e832d23e-a4ca-46aa-a9ef-c732d85ce2ac tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.167083 Sep 15 07:41:04.579430 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 130/277] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:04 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:05.379801 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d2c6a4f7-8d2c-4584-9f5f-913fa9c1dc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:05.382471 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d2c6a4f7-8d2c-4584-9f5f-913fa9c1dc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:05.391973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2c6a4f7-8d2c-4584-9f5f-913fa9c1dc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:05.393923 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2c6a4f7-8d2c-4584-9f5f-913fa9c1dc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:05.394569 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2c6a4f7-8d2c-4584-9f5f-913fa9c1dc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:05.396042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2c6a4f7-8d2c-4584-9f5f-913fa9c1dc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:05.396723 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2c6a4f7-8d2c-4584-9f5f-913fa9c1dc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:05.397359 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2c6a4f7-8d2c-4584-9f5f-913fa9c1dc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:05.410557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:05.453550 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:05.454246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:05.458589 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:05.465509 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:05.466333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:05.467090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:05.469430 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:05.470061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:05.470596 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:05.710741 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d2c6a4f7-8d2c-4584-9f5f-913fa9c1dc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:05.720247 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d2c6a4f7-8d2c-4584-9f5f-913fa9c1dc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1319 microversion: 2.1 time: 0.347682 Sep 15 07:41:05.721298 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 148/278] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:05 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:05.725992 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bba3d248-6cbc-4427-9fc1-8983dc7fe452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:05.726956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bba3d248-6cbc-4427-9fc1-8983dc7fe452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:05.735487 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bba3d248-6cbc-4427-9fc1-8983dc7fe452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:05.736228 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bba3d248-6cbc-4427-9fc1-8983dc7fe452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:05.736897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bba3d248-6cbc-4427-9fc1-8983dc7fe452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:05.737942 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bba3d248-6cbc-4427-9fc1-8983dc7fe452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:05.738648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bba3d248-6cbc-4427-9fc1-8983dc7fe452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:05.739323 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bba3d248-6cbc-4427-9fc1-8983dc7fe452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:05.847576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:05.858054 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:05.867770 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:05.869522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7898344f-fdcf-4e5d-a524-c3218b1d9380 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1739 microversion: 2.20 time: 0.420517 Sep 15 07:41:05.871795 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 131/279] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:05 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:06.280154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bba3d248-6cbc-4427-9fc1-8983dc7fe452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:06.286998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bba3d248-6cbc-4427-9fc1-8983dc7fe452 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.564489 Sep 15 07:41:06.303137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 149/280] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:05 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:06.747120 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f981c8a2-c985-4122-90a9-c0f18a2e1e12 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:06.750835 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f981c8a2-c985-4122-90a9-c0f18a2e1e12 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:06.774479 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=8 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:06.774479 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f981c8a2-c985-4122-90a9-c0f18a2e1e12 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:06.774479 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f981c8a2-c985-4122-90a9-c0f18a2e1e12 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:06.774479 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f981c8a2-c985-4122-90a9-c0f18a2e1e12 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:06.775216 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f981c8a2-c985-4122-90a9-c0f18a2e1e12 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:06.775216 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f981c8a2-c985-4122-90a9-c0f18a2e1e12 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:06.775216 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f981c8a2-c985-4122-90a9-c0f18a2e1e12 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:06.898118 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:06.898728 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:06.908137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:06.908630 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:06.909068 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:06.913830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:06.914608 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:06.915084 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:06.957688 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:07.257450 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f981c8a2-c985-4122-90a9-c0f18a2e1e12 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:07.265038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f981c8a2-c985-4122-90a9-c0f18a2e1e12 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1319 microversion: 2.1 time: 0.524474 Sep 15 07:41:07.266474 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 132/281] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:06 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:07.313370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a5e75053-e083-4a42-aca8-c6820bace78c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:07.314297 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a5e75053-e083-4a42-aca8-c6820bace78c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:07.320400 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a5e75053-e083-4a42-aca8-c6820bace78c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:07.321098 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a5e75053-e083-4a42-aca8-c6820bace78c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:07.321717 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a5e75053-e083-4a42-aca8-c6820bace78c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:07.322562 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a5e75053-e083-4a42-aca8-c6820bace78c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:07.323312 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a5e75053-e083-4a42-aca8-c6820bace78c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:07.323746 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a5e75053-e083-4a42-aca8-c6820bace78c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:07.443017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:07.452258 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:07.457735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:07.457735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2d0b54be-1c2e-41e0-bd04-8294e49a3869 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1721 microversion: 2.20 time: 0.561669 Sep 15 07:41:07.457735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 150/282] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:06 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1721 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:07.539293 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a5e75053-e083-4a42-aca8-c6820bace78c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:07.547872 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a5e75053-e083-4a42-aca8-c6820bace78c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.239605 Sep 15 07:41:07.548646 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 133/283] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:07 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:08.293091 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-32bad33c-fde2-435e-8acc-8789fc3b7bc2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:08.294721 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-32bad33c-fde2-435e-8acc-8789fc3b7bc2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:08.303406 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-32bad33c-fde2-435e-8acc-8789fc3b7bc2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:08.303951 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-32bad33c-fde2-435e-8acc-8789fc3b7bc2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:08.304597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-32bad33c-fde2-435e-8acc-8789fc3b7bc2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:08.305308 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-32bad33c-fde2-435e-8acc-8789fc3b7bc2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:08.305963 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-32bad33c-fde2-435e-8acc-8789fc3b7bc2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:08.306392 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-32bad33c-fde2-435e-8acc-8789fc3b7bc2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:08.487353 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:08.488027 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:08.494849 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:08.495475 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:08.496035 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:08.496841 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:08.497361 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:08.497876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:08.611758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-32bad33c-fde2-435e-8acc-8789fc3b7bc2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:08.620549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-32bad33c-fde2-435e-8acc-8789fc3b7bc2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1319 microversion: 2.1 time: 0.334728 Sep 15 07:41:08.623468 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 151/284] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:08 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:08.637138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-73815072-ea97-424c-814e-0ea819849612 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:08.638262 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-73815072-ea97-424c-814e-0ea819849612 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:08.650128 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-73815072-ea97-424c-814e-0ea819849612 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:08.650660 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-73815072-ea97-424c-814e-0ea819849612 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:08.651229 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-73815072-ea97-424c-814e-0ea819849612 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:08.651954 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-73815072-ea97-424c-814e-0ea819849612 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:08.653135 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-73815072-ea97-424c-814e-0ea819849612 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:08.653591 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-73815072-ea97-424c-814e-0ea819849612 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:08.792544 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:08.824072 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:08.826673 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:08.830131 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-892e9509-722f-41aa-9d88-f4b40ae2aa6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1721 microversion: 2.20 time: 0.347801 Sep 15 07:41:08.848785 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 134/285] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:08 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1721 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:08.864665 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-ade4f8fc-a45b-4df7-96d9-ac627c8cf3d6 req-f2399d0b-3602-4e51-a68e-5de54f89a81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dfb32-7368-4c35-8631-f0ca8b7e2680", "name": "network-vif-plugged", "status": "completed", "tag": "5f558303-6561-42ea-8bcc-d87ad98fc906"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:08.876434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-ade4f8fc-a45b-4df7-96d9-ac627c8cf3d6 req-f2399d0b-3602-4e51-a68e-5de54f89a81b service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:08.878530 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-ade4f8fc-a45b-4df7-96d9-ac627c8cf3d6 req-f2399d0b-3602-4e51-a68e-5de54f89a81b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:08.878530 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-ade4f8fc-a45b-4df7-96d9-ac627c8cf3d6 req-f2399d0b-3602-4e51-a68e-5de54f89a81b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:08.881949 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=100 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:08.887067 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-73815072-ea97-424c-814e-0ea819849612 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:08.892893 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-ade4f8fc-a45b-4df7-96d9-ac627c8cf3d6 req-f2399d0b-3602-4e51-a68e-5de54f89a81b service nova] Creating event network-vif-plugged:5f558303-6561-42ea-8bcc-d87ad98fc906 for instance 417dfb32-7368-4c35-8631-f0ca8b7e2680 on hv-cinder-82414 Sep 15 07:41:08.895442 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-73815072-ea97-424c-814e-0ea819849612 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.262581 Sep 15 07:41:08.898639 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-ade4f8fc-a45b-4df7-96d9-ac627c8cf3d6 req-f2399d0b-3602-4e51-a68e-5de54f89a81b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047759 Sep 15 07:41:08.899289 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 152/286] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:08 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:08.908393 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 135/287] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:41:09.646608 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-eac8a029-5eca-44b1-a7e2-1c2101da3006 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:09.647230 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-eac8a029-5eca-44b1-a7e2-1c2101da3006 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:09.654246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eac8a029-5eca-44b1-a7e2-1c2101da3006 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:09.655017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eac8a029-5eca-44b1-a7e2-1c2101da3006 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:09.655694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eac8a029-5eca-44b1-a7e2-1c2101da3006 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:09.656688 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eac8a029-5eca-44b1-a7e2-1c2101da3006 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:09.657363 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eac8a029-5eca-44b1-a7e2-1c2101da3006 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:09.660318 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eac8a029-5eca-44b1-a7e2-1c2101da3006 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:09.866758 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:09.868162 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:09.885237 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:09.885237 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:09.885551 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:09.886242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:09.886698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:09.887124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:09.977277 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-eac8a029-5eca-44b1-a7e2-1c2101da3006 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:09.991150 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-eac8a029-5eca-44b1-a7e2-1c2101da3006 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1319 microversion: 2.1 time: 0.348292 Sep 15 07:41:09.991745 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 153/288] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:09 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:09.996647 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-044ad3ed-3c75-4c05-a1c0-08b4c1971fe3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:10.004897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-044ad3ed-3c75-4c05-a1c0-08b4c1971fe3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:10.004897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-044ad3ed-3c75-4c05-a1c0-08b4c1971fe3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:10.004897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-044ad3ed-3c75-4c05-a1c0-08b4c1971fe3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:10.005433 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-044ad3ed-3c75-4c05-a1c0-08b4c1971fe3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:10.006356 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-044ad3ed-3c75-4c05-a1c0-08b4c1971fe3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:10.006984 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-044ad3ed-3c75-4c05-a1c0-08b4c1971fe3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:10.007427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-044ad3ed-3c75-4c05-a1c0-08b4c1971fe3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:10.311892 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:10.323099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:10.325443 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:10.326706 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b7939340-7670-416c-a85b-f90761810732 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1724 microversion: 2.20 time: 0.467945 Sep 15 07:41:10.329778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 136/289] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:09 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1724 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:10.336943 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-044ad3ed-3c75-4c05-a1c0-08b4c1971fe3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:10.349025 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-044ad3ed-3c75-4c05-a1c0-08b4c1971fe3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.354151 Sep 15 07:41:10.350507 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 154/290] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:09 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:10.356711 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-cb3d2982-2ce2-4af2-9897-f3b4d956368e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02ac7681-a783-427b-8d56-4462630a3794"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:10.364253 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-cb3d2982-2ce2-4af2-9897-f3b4d956368e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:10.375239 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cb3d2982-2ce2-4af2-9897-f3b4d956368e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:10.376188 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cb3d2982-2ce2-4af2-9897-f3b4d956368e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:10.376779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cb3d2982-2ce2-4af2-9897-f3b4d956368e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:10.377762 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cb3d2982-2ce2-4af2-9897-f3b4d956368e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:10.378363 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cb3d2982-2ce2-4af2-9897-f3b4d956368e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:10.378926 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cb3d2982-2ce2-4af2-9897-f3b4d956368e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:10.937366 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-498880a7-8a9a-44c2-b57f-4f9fca828285 req-8388fc07-4e49-4727-b1d4-7fafc1d29e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ae2103-9abb-45d7-94b1-7e0f83c44fa0", "name": "network-vif-unplugged", "status": "completed", "tag": "60114f49-493e-46b0-a653-b05d4362ebe7"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:10.950673 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:10.954156 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-498880a7-8a9a-44c2-b57f-4f9fca828285 req-8388fc07-4e49-4727-b1d4-7fafc1d29e36 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:10.955470 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-498880a7-8a9a-44c2-b57f-4f9fca828285 req-8388fc07-4e49-4727-b1d4-7fafc1d29e36 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:10.956068 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-498880a7-8a9a-44c2-b57f-4f9fca828285 req-8388fc07-4e49-4727-b1d4-7fafc1d29e36 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:10.975658 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.compute.server_external_events [req-498880a7-8a9a-44c2-b57f-4f9fca828285 req-8388fc07-4e49-4727-b1d4-7fafc1d29e36 service nova] Unable to find a host for instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0. Dropping event network-vif-unplugged {{(pid=132674) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 15 07:41:10.976443 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-498880a7-8a9a-44c2-b57f-4f9fca828285 req-8388fc07-4e49-4727-b1d4-7fafc1d29e36 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043890 Sep 15 07:41:10.977033 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 155/291] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 15 07:41:11.026067 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-089b4de0-6e22-4063-b30f-180ee194cc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:11.026681 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-089b4de0-6e22-4063-b30f-180ee194cc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:11.033272 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-089b4de0-6e22-4063-b30f-180ee194cc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:11.033996 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-089b4de0-6e22-4063-b30f-180ee194cc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:11.034466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-089b4de0-6e22-4063-b30f-180ee194cc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:11.035159 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-089b4de0-6e22-4063-b30f-180ee194cc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:11.035610 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-089b4de0-6e22-4063-b30f-180ee194cc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:11.036035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-089b4de0-6e22-4063-b30f-180ee194cc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:11.196776 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-089b4de0-6e22-4063-b30f-180ee194cc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:11.206412 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-089b4de0-6e22-4063-b30f-180ee194cc18 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1319 microversion: 2.1 time: 0.184206 Sep 15 07:41:11.206990 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 156/292] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:11 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:11.378267 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-71b6f66b-3553-44aa-97a7-f14b296a6063 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:11.379294 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-71b6f66b-3553-44aa-97a7-f14b296a6063 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:11.395045 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b6f66b-3553-44aa-97a7-f14b296a6063 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:11.395552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b6f66b-3553-44aa-97a7-f14b296a6063 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:11.396064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b6f66b-3553-44aa-97a7-f14b296a6063 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:11.397021 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b6f66b-3553-44aa-97a7-f14b296a6063 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:11.397864 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b6f66b-3553-44aa-97a7-f14b296a6063 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:11.398520 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-71b6f66b-3553-44aa-97a7-f14b296a6063 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:11.559198 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-71b6f66b-3553-44aa-97a7-f14b296a6063 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:11.568676 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-71b6f66b-3553-44aa-97a7-f14b296a6063 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.197106 Sep 15 07:41:11.571272 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 157/293] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:11 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:11.699025 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-cb3d2982-2ce2-4af2-9897-f3b4d956368e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "POST /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.348169 Sep 15 07:41:11.699025 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 137/294] 10.222.0.42 () {62 vars in 1364 bytes} [Thu Sep 15 07:41:10 2022] POST /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments => generated 188 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:41:11.868008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-8db88e69-9570-4f5c-becf-63fb79a4fefb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:11.869149 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-8db88e69-9570-4f5c-becf-63fb79a4fefb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:11.877733 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8db88e69-9570-4f5c-becf-63fb79a4fefb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:11.878428 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8db88e69-9570-4f5c-becf-63fb79a4fefb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:11.878963 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8db88e69-9570-4f5c-becf-63fb79a4fefb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:11.880818 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8db88e69-9570-4f5c-becf-63fb79a4fefb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:11.881542 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8db88e69-9570-4f5c-becf-63fb79a4fefb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:11.883018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8db88e69-9570-4f5c-becf-63fb79a4fefb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:11.956313 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-8db88e69-9570-4f5c-becf-63fb79a4fefb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132674) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 07:41:12.239715 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-250295a1-761a-4f02-b0df-15eeca28af6c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:12.241933 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-250295a1-761a-4f02-b0df-15eeca28af6c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:12.252844 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-250295a1-761a-4f02-b0df-15eeca28af6c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:12.253507 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-250295a1-761a-4f02-b0df-15eeca28af6c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:12.262703 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-250295a1-761a-4f02-b0df-15eeca28af6c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:12.262703 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-250295a1-761a-4f02-b0df-15eeca28af6c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:12.262703 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-250295a1-761a-4f02-b0df-15eeca28af6c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:12.262703 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-250295a1-761a-4f02-b0df-15eeca28af6c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:12.337321 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-8db88e69-9570-4f5c-becf-63fb79a4fefb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "POST /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/action" status: 202 len: 0 microversion: 2.20 time: 0.474931 Sep 15 07:41:12.338638 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 158/295] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 15 07:41:11 2022] POST /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:41:12.349802 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:12.350671 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:12.363955 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:12.363955 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:12.363955 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:12.363955 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:12.364411 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:12.364411 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:12.468141 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-250295a1-761a-4f02-b0df-15eeca28af6c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:12.472595 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-250295a1-761a-4f02-b0df-15eeca28af6c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1509 microversion: 2.1 time: 0.241506 Sep 15 07:41:12.473659 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 138/296] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:12 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:12.595214 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d171f476-f7fe-43dc-9284-221a18427d01 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:12.595900 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d171f476-f7fe-43dc-9284-221a18427d01 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:12.600987 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:12.614369 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d171f476-f7fe-43dc-9284-221a18427d01 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:12.614912 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d171f476-f7fe-43dc-9284-221a18427d01 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:12.615362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d171f476-f7fe-43dc-9284-221a18427d01 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:12.616082 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d171f476-f7fe-43dc-9284-221a18427d01 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:12.619571 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d171f476-f7fe-43dc-9284-221a18427d01 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:12.620207 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d171f476-f7fe-43dc-9284-221a18427d01 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:12.620577 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:12.623185 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:12.624668 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fc517c25-dca2-4b1b-b2f9-c70d7f87ea8d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1750 microversion: 2.20 time: 0.282439 Sep 15 07:41:12.633183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 159/297] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:12 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1750 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:12.910244 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d171f476-f7fe-43dc-9284-221a18427d01 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:12.920889 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d171f476-f7fe-43dc-9284-221a18427d01 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.332922 Sep 15 07:41:12.927866 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 139/298] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:12 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:13.661627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:13.662325 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:13.668603 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:13.669434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:13.669849 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:13.670556 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:13.671202 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:13.671628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:13.956173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0e45d486-cde8-4e9f-b21b-04189aa2848e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:13.956801 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0e45d486-cde8-4e9f-b21b-04189aa2848e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:13.972457 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e45d486-cde8-4e9f-b21b-04189aa2848e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:13.975652 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e45d486-cde8-4e9f-b21b-04189aa2848e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:13.975652 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e45d486-cde8-4e9f-b21b-04189aa2848e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:13.987563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e45d486-cde8-4e9f-b21b-04189aa2848e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:13.988223 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e45d486-cde8-4e9f-b21b-04189aa2848e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:13.988682 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e45d486-cde8-4e9f-b21b-04189aa2848e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:14.203948 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:14.258184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:14.259770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:14.279105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-37c83c8c-749d-4a3f-b3b4-92de8402008b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1750 microversion: 2.20 time: 0.603506 Sep 15 07:41:14.279773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 160/299] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:13 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1750 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:14.364435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0e45d486-cde8-4e9f-b21b-04189aa2848e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:14.381818 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0e45d486-cde8-4e9f-b21b-04189aa2848e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.432211 Sep 15 07:41:14.381818 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 140/300] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:13 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:15.308857 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:15.309481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:15.318574 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:15.319080 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:15.319514 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:15.321494 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:15.322014 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:15.322443 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:15.401529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ce29c664-f07e-4777-85dc-f5bb1d8e2235 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:15.402260 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ce29c664-f07e-4777-85dc-f5bb1d8e2235 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:15.413486 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce29c664-f07e-4777-85dc-f5bb1d8e2235 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:15.414014 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce29c664-f07e-4777-85dc-f5bb1d8e2235 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:15.414459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce29c664-f07e-4777-85dc-f5bb1d8e2235 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:15.415342 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce29c664-f07e-4777-85dc-f5bb1d8e2235 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:15.415882 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce29c664-f07e-4777-85dc-f5bb1d8e2235 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:15.416431 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce29c664-f07e-4777-85dc-f5bb1d8e2235 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:15.561756 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:15.577335 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:15.579634 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:15.580714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2adebf33-3ca9-4c08-858b-3bc713515511 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1750 microversion: 2.20 time: 0.276274 Sep 15 07:41:15.581635 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 161/301] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:15 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1750 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:15.648533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ce29c664-f07e-4777-85dc-f5bb1d8e2235 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:15.656417 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ce29c664-f07e-4777-85dc-f5bb1d8e2235 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.259001 Sep 15 07:41:15.657519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 141/302] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:15 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:16.612564 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:16.613273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:16.620155 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:16.620726 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:16.621437 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:16.622670 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:16.623529 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:16.623965 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:16.682085 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9c000d48-9cc9-426f-80e3-29f77a8e1698 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:16.690366 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-9c000d48-9cc9-426f-80e3-29f77a8e1698 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:16.701675 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c000d48-9cc9-426f-80e3-29f77a8e1698 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:16.702409 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c000d48-9cc9-426f-80e3-29f77a8e1698 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:16.703116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c000d48-9cc9-426f-80e3-29f77a8e1698 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:16.704911 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c000d48-9cc9-426f-80e3-29f77a8e1698 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:16.706525 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c000d48-9cc9-426f-80e3-29f77a8e1698 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:16.707277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c000d48-9cc9-426f-80e3-29f77a8e1698 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:16.893769 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:16.905114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:16.907768 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:16.909699 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-680f31f5-7c33-4f9f-a0db-18a560bd9d4e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1752 microversion: 2.20 time: 0.301932 Sep 15 07:41:16.926001 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 162/303] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:16 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1752 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:16.954717 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-9c000d48-9cc9-426f-80e3-29f77a8e1698 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:16.964458 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9c000d48-9cc9-426f-80e3-29f77a8e1698 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.287745 Sep 15 07:41:16.966842 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 142/304] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:16 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:17.942867 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:17.944703 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:17.962023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:17.967055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:17.967750 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:17.968690 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:17.969473 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:17.970098 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:17.999297 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-406aa5ba-20d8-4bc8-ba4f-0ac290cf3ca3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:18.000707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-406aa5ba-20d8-4bc8-ba4f-0ac290cf3ca3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:18.010011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-406aa5ba-20d8-4bc8-ba4f-0ac290cf3ca3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:18.010820 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-406aa5ba-20d8-4bc8-ba4f-0ac290cf3ca3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:18.012178 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-406aa5ba-20d8-4bc8-ba4f-0ac290cf3ca3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:18.013707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-406aa5ba-20d8-4bc8-ba4f-0ac290cf3ca3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:18.014246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-406aa5ba-20d8-4bc8-ba4f-0ac290cf3ca3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:18.014747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-406aa5ba-20d8-4bc8-ba4f-0ac290cf3ca3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:18.392249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:18.403719 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-406aa5ba-20d8-4bc8-ba4f-0ac290cf3ca3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:18.413237 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-406aa5ba-20d8-4bc8-ba4f-0ac290cf3ca3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1522 microversion: 2.1 time: 0.426664 Sep 15 07:41:18.414222 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 143/305] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:17 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:18.426926 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:18.428615 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:18.430987 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bf7178ba-e7b7-4441-a933-040c9551d8b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1752 microversion: 2.20 time: 0.493126 Sep 15 07:41:18.432087 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 163/306] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:17 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1752 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:19.328217 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e72c93c5-253f-4d87-8a74-48e5fcdd662b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Action: 'create', calling method: .version_select at 0x7ff36ca15550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2002691772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFn7ywEgnNK9ZIGKN1QxSeaEqhRF0RJuG1MGvZ1u1f5FV2CNfgW//NTo5RQ7am4G/aF7Owkl7aItNJLODmw1Ibtf1JQk1ObesAelo6iDf24sEGLhkLrbuau0u/IYIFFXJg=="}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:19.347347 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-e72c93c5-253f-4d87-8a74-48e5fcdd662b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Getting quotas for project af1e008c4bfa41e18488c63ea0f17b27. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:41:19.353733 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-e72c93c5-253f-4d87-8a74-48e5fcdd662b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Getting quotas for user ebd85e42855448268c89a200f4392316 and project af1e008c4bfa41e18488c63ea0f17b27. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:41:19.443275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9d6fa22b-215b-4cb7-ac97-c1d78b050815 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:19.444020 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9d6fa22b-215b-4cb7-ac97-c1d78b050815 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:19.458202 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9d6fa22b-215b-4cb7-ac97-c1d78b050815 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:19.459006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9d6fa22b-215b-4cb7-ac97-c1d78b050815 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:19.459740 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9d6fa22b-215b-4cb7-ac97-c1d78b050815 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:19.460691 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9d6fa22b-215b-4cb7-ac97-c1d78b050815 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:19.461392 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9d6fa22b-215b-4cb7-ac97-c1d78b050815 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:19.462087 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9d6fa22b-215b-4cb7-ac97-c1d78b050815 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:19.482924 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e72c93c5-253f-4d87-8a74-48e5fcdd662b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.283904 Sep 15 07:41:19.483552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 144/307] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 15 07:41:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:41:19.503926 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:19.504566 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:19.512089 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:19.512601 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:19.513655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:19.514391 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:19.514854 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:19.515285 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:20.076405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9d6fa22b-215b-4cb7-ac97-c1d78b050815 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:20.094109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9d6fa22b-215b-4cb7-ac97-c1d78b050815 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1502 microversion: 2.1 time: 0.661269 Sep 15 07:41:20.095279 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 164/308] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:19 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1502 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:20.100194 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:20.122593 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7f0da85e-09ef-4535-843c-d30a7c029438 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:20.123302 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7f0da85e-09ef-4535-843c-d30a7c029438 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:20.124460 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:20.127149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:20.128645 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4d94d06d-b31a-4d4d-bb84-299362517e2b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.643858 Sep 15 07:41:20.129485 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 145/309] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:19 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:20.139543 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7f0da85e-09ef-4535-843c-d30a7c029438 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:20.141124 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7f0da85e-09ef-4535-843c-d30a7c029438 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:20.147675 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7f0da85e-09ef-4535-843c-d30a7c029438 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:20.148778 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7f0da85e-09ef-4535-843c-d30a7c029438 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:20.149447 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7f0da85e-09ef-4535-843c-d30a7c029438 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:20.149935 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7f0da85e-09ef-4535-843c-d30a7c029438 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:20.365927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7f0da85e-09ef-4535-843c-d30a7c029438 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:20.374375 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7f0da85e-09ef-4535-843c-d30a7c029438 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1516 microversion: 2.1 time: 0.256366 Sep 15 07:41:20.375241 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 165/310] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:20 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:21.159639 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:21.160956 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:21.175186 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:21.176148 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:21.176971 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:21.177937 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:21.179319 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:21.179933 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:21.415568 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:21.431756 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:21.433197 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:21.434941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-220da5c4-fa1b-4033-8503-22719273f8c8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.281642 Sep 15 07:41:21.435491 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 146/311] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:21 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:22.424491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-88b1a467-14f2-4d21-9477-d89545a2b59d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:22.427434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-88b1a467-14f2-4d21-9477-d89545a2b59d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:22.447728 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-88b1a467-14f2-4d21-9477-d89545a2b59d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:22.448273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-88b1a467-14f2-4d21-9477-d89545a2b59d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:22.450031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-88b1a467-14f2-4d21-9477-d89545a2b59d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:22.450861 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-88b1a467-14f2-4d21-9477-d89545a2b59d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:22.451345 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-88b1a467-14f2-4d21-9477-d89545a2b59d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:22.453783 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-88b1a467-14f2-4d21-9477-d89545a2b59d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:22.470008 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:22.470008 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:22.471521 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:22.472536 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:22.473405 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:22.475421 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:22.477981 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:22.478840 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:22.519007 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-88b1a467-14f2-4d21-9477-d89545a2b59d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lazy-loading 'flavor' on Instance uuid 48afb5a2-e7d3-44a4-8882-d81cfd5418ab {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:41:22.605211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:22.710913 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:22.731020 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:22.737641 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:22.737641 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8a78f6b1-27e1-4c97-8527-4df4bea6077f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.275930 Sep 15 07:41:22.737641 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 147/312] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:22 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:23.055157 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-88b1a467-14f2-4d21-9477-d89545a2b59d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "POST /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab/action" status: 200 len: 32 microversion: 2.1 time: 0.635061 Sep 15 07:41:23.056346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 166/313] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:41:22 2022] POST /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab/action => generated 32 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 07:41:23.066832 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d7a440cd-4de3-4539-b958-b6cd2ac61024 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:23.067931 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d7a440cd-4de3-4539-b958-b6cd2ac61024 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:23.074533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7a440cd-4de3-4539-b958-b6cd2ac61024 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:23.075440 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7a440cd-4de3-4539-b958-b6cd2ac61024 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:23.076107 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7a440cd-4de3-4539-b958-b6cd2ac61024 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:23.077151 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7a440cd-4de3-4539-b958-b6cd2ac61024 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:23.077881 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7a440cd-4de3-4539-b958-b6cd2ac61024 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:23.078531 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d7a440cd-4de3-4539-b958-b6cd2ac61024 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:23.304725 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d7a440cd-4de3-4539-b958-b6cd2ac61024 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:23.328181 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d7a440cd-4de3-4539-b958-b6cd2ac61024 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.266054 Sep 15 07:41:23.331472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 148/314] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:23 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:23.771487 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:23.773166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:23.791100 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:23.791891 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:23.796022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:23.796022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:23.796022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:23.796022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:24.000625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:24.020862 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:24.023576 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:24.025085 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-eb65a67c-bf42-40ce-9cfe-584210b766f4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.265876 Sep 15 07:41:24.038485 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 167/315] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:23 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:24.358113 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4462a2dd-47b3-454f-8f88-bd573226fbfa tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:24.359964 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4462a2dd-47b3-454f-8f88-bd573226fbfa tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:24.373696 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4462a2dd-47b3-454f-8f88-bd573226fbfa tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:24.374445 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4462a2dd-47b3-454f-8f88-bd573226fbfa tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:24.375182 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4462a2dd-47b3-454f-8f88-bd573226fbfa tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:24.375807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4462a2dd-47b3-454f-8f88-bd573226fbfa tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:24.376480 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4462a2dd-47b3-454f-8f88-bd573226fbfa tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:24.376909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4462a2dd-47b3-454f-8f88-bd573226fbfa tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:24.705945 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4462a2dd-47b3-454f-8f88-bd573226fbfa tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:24.716719 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4462a2dd-47b3-454f-8f88-bd573226fbfa tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.364661 Sep 15 07:41:24.722340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 149/316] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:24 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:25.058568 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:25.059256 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:25.066095 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:25.066588 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:25.067032 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:25.067766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:25.068205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:25.068634 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:25.259545 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:25.284600 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:25.286252 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:25.287696 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7c25e349-743c-4df9-9776-61d4c36db286 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.233851 Sep 15 07:41:25.288342 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 168/317] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:25 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:25.760166 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-28c73bbd-bd94-48a7-ae93-533d454dd485 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:25.761704 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-28c73bbd-bd94-48a7-ae93-533d454dd485 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:25.770364 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c73bbd-bd94-48a7-ae93-533d454dd485 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:25.772383 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c73bbd-bd94-48a7-ae93-533d454dd485 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:25.773248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c73bbd-bd94-48a7-ae93-533d454dd485 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:25.775944 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c73bbd-bd94-48a7-ae93-533d454dd485 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:25.778657 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c73bbd-bd94-48a7-ae93-533d454dd485 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:25.780119 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c73bbd-bd94-48a7-ae93-533d454dd485 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:26.001724 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-28c73bbd-bd94-48a7-ae93-533d454dd485 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:26.005443 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:26.019157 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-28c73bbd-bd94-48a7-ae93-533d454dd485 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.268035 Sep 15 07:41:26.021206 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 150/318] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:25 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:26.326625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:26.327246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:26.333949 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:26.334438 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:26.334885 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:26.335581 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:26.336040 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:26.336471 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:26.534567 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:26.546150 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:26.548231 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:26.549929 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1bf1ac3f-2a53-4f9c-a014-33a29b47fd97 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.227139 Sep 15 07:41:26.551009 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 169/319] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:26 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:27.045450 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a53f7858-4a1b-4310-9dfc-d5a50f9f25bd tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:27.046345 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a53f7858-4a1b-4310-9dfc-d5a50f9f25bd tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:27.056960 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a53f7858-4a1b-4310-9dfc-d5a50f9f25bd tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:27.057459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a53f7858-4a1b-4310-9dfc-d5a50f9f25bd tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:27.058002 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a53f7858-4a1b-4310-9dfc-d5a50f9f25bd tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:27.058754 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a53f7858-4a1b-4310-9dfc-d5a50f9f25bd tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:27.059217 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a53f7858-4a1b-4310-9dfc-d5a50f9f25bd tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:27.059644 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a53f7858-4a1b-4310-9dfc-d5a50f9f25bd tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:27.201997 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a53f7858-4a1b-4310-9dfc-d5a50f9f25bd tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:27.210567 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a53f7858-4a1b-4310-9dfc-d5a50f9f25bd tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.169716 Sep 15 07:41:27.211143 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 151/320] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:27 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:27.576670 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:27.577999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:27.585658 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:27.585984 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:27.586452 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:27.590176 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:27.590176 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:27.590176 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:27.850658 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:27.859868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:27.862870 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:27.864049 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-8dd8e744-72af-4b38-8c52-bf4937875122 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.291418 Sep 15 07:41:27.864653 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 170/321] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:27 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:28.235210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-962cdfab-e154-4804-8f36-a49e966b637b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:28.236333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-962cdfab-e154-4804-8f36-a49e966b637b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:28.243502 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-962cdfab-e154-4804-8f36-a49e966b637b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:28.244036 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-962cdfab-e154-4804-8f36-a49e966b637b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:28.244479 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-962cdfab-e154-4804-8f36-a49e966b637b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:28.245207 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-962cdfab-e154-4804-8f36-a49e966b637b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:28.245712 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-962cdfab-e154-4804-8f36-a49e966b637b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:28.246363 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-962cdfab-e154-4804-8f36-a49e966b637b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:28.436234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-962cdfab-e154-4804-8f36-a49e966b637b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:28.450789 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-962cdfab-e154-4804-8f36-a49e966b637b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.220171 Sep 15 07:41:28.459878 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 152/322] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:28 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:28.893526 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:28.894909 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:28.901405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:28.902096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:28.902713 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:28.903578 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:28.904182 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:28.904759 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:29.089103 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:29.097663 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:29.099115 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:29.100281 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ae33258c-68cb-451b-a3bb-11387c271512 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.211746 Sep 15 07:41:29.100837 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 171/323] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:28 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:29.476443 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-445d4794-4299-40c6-a963-df22e5015a14 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:29.480236 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-445d4794-4299-40c6-a963-df22e5015a14 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:29.481867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=4 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:29.498406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-445d4794-4299-40c6-a963-df22e5015a14 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:29.498955 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-445d4794-4299-40c6-a963-df22e5015a14 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:29.499404 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-445d4794-4299-40c6-a963-df22e5015a14 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:29.500111 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-445d4794-4299-40c6-a963-df22e5015a14 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:29.500567 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-445d4794-4299-40c6-a963-df22e5015a14 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:29.500984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-445d4794-4299-40c6-a963-df22e5015a14 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:29.726959 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-445d4794-4299-40c6-a963-df22e5015a14 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:29.735595 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-445d4794-4299-40c6-a963-df22e5015a14 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.264621 Sep 15 07:41:29.744872 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 153/324] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:29 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:30.141408 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:30.145418 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:30.153895 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:30.154823 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:30.155447 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:30.156326 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:30.156937 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:30.157559 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:30.377230 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:30.386957 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:30.388614 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:30.395426 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-25d0f05f-fc58-4992-87cd-04137efd22f8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.265150 Sep 15 07:41:30.396721 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 172/325] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:30 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:30.759436 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-cf471675-d335-47a7-a2e2-8107a4485824 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:30.760047 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-cf471675-d335-47a7-a2e2-8107a4485824 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:30.767422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf471675-d335-47a7-a2e2-8107a4485824 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:30.768560 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf471675-d335-47a7-a2e2-8107a4485824 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:30.769190 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf471675-d335-47a7-a2e2-8107a4485824 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:30.770183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf471675-d335-47a7-a2e2-8107a4485824 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:30.774057 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf471675-d335-47a7-a2e2-8107a4485824 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:30.774057 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf471675-d335-47a7-a2e2-8107a4485824 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:30.933808 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-cf471675-d335-47a7-a2e2-8107a4485824 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:30.943884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-cf471675-d335-47a7-a2e2-8107a4485824 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.188251 Sep 15 07:41:30.944681 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 154/326] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:30 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:31.428062 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:31.429282 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:31.437344 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:31.438146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:31.438756 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:31.440717 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:31.441376 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:31.442038 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:31.609560 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:31.620787 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:31.622741 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:31.624351 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3eacd08f-c564-45fd-a9d5-351b2da6c6b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.201614 Sep 15 07:41:31.633368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 173/327] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:31 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:31.969244 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0470fa40-2327-4c5e-bd35-30746dce544d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:31.974600 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0470fa40-2327-4c5e-bd35-30746dce544d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:31.979076 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0470fa40-2327-4c5e-bd35-30746dce544d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:31.979789 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0470fa40-2327-4c5e-bd35-30746dce544d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:31.980428 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0470fa40-2327-4c5e-bd35-30746dce544d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:31.983519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0470fa40-2327-4c5e-bd35-30746dce544d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:31.984459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0470fa40-2327-4c5e-bd35-30746dce544d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:31.985367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0470fa40-2327-4c5e-bd35-30746dce544d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:32.179836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0470fa40-2327-4c5e-bd35-30746dce544d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:32.188616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0470fa40-2327-4c5e-bd35-30746dce544d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.223907 Sep 15 07:41:32.189614 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 155/328] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:31 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:32.654994 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:32.655579 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:32.662674 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:32.663160 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:32.663591 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:32.664291 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:32.664734 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:32.665155 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:32.924962 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:32.949278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:32.953057 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:32.957770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1769b2ae-f99d-4b23-bc37-f84229892399 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.306686 Sep 15 07:41:32.959373 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 174/329] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:32 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:33.229892 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bf6e90de-e74a-494d-a4cd-87088902c9ce tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:33.229892 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bf6e90de-e74a-494d-a4cd-87088902c9ce tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:33.231702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1ea99b81-46c0-495b-afa6-1c5b49c9ab84 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff038343-2856-4780-81d6-c65234f87d6e", "device": "/dev/sdb"}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:33.234717 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1ea99b81-46c0-495b-afa6-1c5b49c9ab84 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:33.238019 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf6e90de-e74a-494d-a4cd-87088902c9ce tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:33.239066 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf6e90de-e74a-494d-a4cd-87088902c9ce tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:33.239331 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf6e90de-e74a-494d-a4cd-87088902c9ce tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:33.240575 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf6e90de-e74a-494d-a4cd-87088902c9ce tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:33.241376 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf6e90de-e74a-494d-a4cd-87088902c9ce tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:33.242173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf6e90de-e74a-494d-a4cd-87088902c9ce tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:33.243736 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1ea99b81-46c0-495b-afa6-1c5b49c9ab84 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:33.244527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1ea99b81-46c0-495b-afa6-1c5b49c9ab84 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:33.245190 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1ea99b81-46c0-495b-afa6-1c5b49c9ab84 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:33.247671 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1ea99b81-46c0-495b-afa6-1c5b49c9ab84 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:33.248544 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1ea99b81-46c0-495b-afa6-1c5b49c9ab84 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:33.250166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1ea99b81-46c0-495b-afa6-1c5b49c9ab84 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:33.468178 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bf6e90de-e74a-494d-a4cd-87088902c9ce tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:33.476909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bf6e90de-e74a-494d-a4cd-87088902c9ce tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.256221 Sep 15 07:41:33.477505 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 156/330] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:33 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:33.988565 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:33.989515 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:33.996634 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:33.996634 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:33.997543 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:33.998046 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:33.998945 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:33.999401 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:33.999826 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:34.200962 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1ea99b81-46c0-495b-afa6-1c5b49c9ab84 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "POST /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.972694 Sep 15 07:41:34.223821 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 175/331] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:41:33 2022] POST /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680/os-volume_attachments => generated 194 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:41:34.247735 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:34.278557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:34.283364 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:34.289304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5a5e65a9-4f3c-4bdb-b5c9-7ebe3a82ba41 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.305361 Sep 15 07:41:34.308039 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 157/332] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:33 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:34.501227 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3d7eaca8-0387-4dc8-bc1b-2d1aeea53c6c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:34.502059 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3d7eaca8-0387-4dc8-bc1b-2d1aeea53c6c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:34.508893 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d7eaca8-0387-4dc8-bc1b-2d1aeea53c6c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:34.509380 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d7eaca8-0387-4dc8-bc1b-2d1aeea53c6c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:34.509869 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d7eaca8-0387-4dc8-bc1b-2d1aeea53c6c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:34.510566 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d7eaca8-0387-4dc8-bc1b-2d1aeea53c6c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:34.511024 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d7eaca8-0387-4dc8-bc1b-2d1aeea53c6c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:34.511450 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d7eaca8-0387-4dc8-bc1b-2d1aeea53c6c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:34.771429 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3d7eaca8-0387-4dc8-bc1b-2d1aeea53c6c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:34.780336 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3d7eaca8-0387-4dc8-bc1b-2d1aeea53c6c tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.283479 Sep 15 07:41:34.781305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 176/333] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:34 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:35.329744 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:35.331816 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:35.341999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:35.342622 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:35.343125 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:35.344016 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:35.344607 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:35.344878 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:35.640369 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:35.654498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:35.656006 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:35.657221 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-cd4a7fba-e4a2-41ad-a7a2-031c4de36986 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.331274 Sep 15 07:41:35.657812 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 158/334] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:35 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:35.804857 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7c2263d7-b7f4-4842-b8dd-0c376fcefd35 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:35.812719 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7c2263d7-b7f4-4842-b8dd-0c376fcefd35 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:35.820872 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c2263d7-b7f4-4842-b8dd-0c376fcefd35 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:35.821660 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c2263d7-b7f4-4842-b8dd-0c376fcefd35 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:35.829597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c2263d7-b7f4-4842-b8dd-0c376fcefd35 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:35.829597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c2263d7-b7f4-4842-b8dd-0c376fcefd35 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:35.829597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c2263d7-b7f4-4842-b8dd-0c376fcefd35 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:35.829597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7c2263d7-b7f4-4842-b8dd-0c376fcefd35 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:36.060968 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7c2263d7-b7f4-4842-b8dd-0c376fcefd35 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:36.074404 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7c2263d7-b7f4-4842-b8dd-0c376fcefd35 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.273652 Sep 15 07:41:36.074993 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 177/335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:35 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:36.684661 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:36.687190 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:36.692602 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:36.693092 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:36.693747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:36.694454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:36.694953 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:36.695326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:36.844683 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:36.857044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:36.858716 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:36.859905 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4a5c28f0-d445-4763-8e01-dfd586d44948 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.180421 Sep 15 07:41:36.874487 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 159/336] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:36 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:37.098695 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bb223e2b-bbf6-4c1b-bb58-69ff8abe25a3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:37.099910 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bb223e2b-bbf6-4c1b-bb58-69ff8abe25a3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:37.106362 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bb223e2b-bbf6-4c1b-bb58-69ff8abe25a3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:37.106843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bb223e2b-bbf6-4c1b-bb58-69ff8abe25a3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:37.107273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bb223e2b-bbf6-4c1b-bb58-69ff8abe25a3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:37.107973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bb223e2b-bbf6-4c1b-bb58-69ff8abe25a3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:37.108466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bb223e2b-bbf6-4c1b-bb58-69ff8abe25a3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:37.108895 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bb223e2b-bbf6-4c1b-bb58-69ff8abe25a3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:37.256516 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bb223e2b-bbf6-4c1b-bb58-69ff8abe25a3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:37.264646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bb223e2b-bbf6-4c1b-bb58-69ff8abe25a3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.170378 Sep 15 07:41:37.265380 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 178/337] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:37 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:37.888449 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:37.889082 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:37.896528 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:37.897681 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:37.898119 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:37.899128 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:37.899247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:37.899661 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:38.079143 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:38.087995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:38.089430 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:38.090686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-cd628511-1e72-4c30-9848-102d671a97a2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.206234 Sep 15 07:41:38.091332 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 160/338] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:37 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:38.294956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d4a1da1b-45b6-4232-a9ae-853ade231d42 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:38.295723 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d4a1da1b-45b6-4232-a9ae-853ade231d42 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:38.302841 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d4a1da1b-45b6-4232-a9ae-853ade231d42 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:38.310826 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d4a1da1b-45b6-4232-a9ae-853ade231d42 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:38.312252 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d4a1da1b-45b6-4232-a9ae-853ade231d42 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:38.313560 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d4a1da1b-45b6-4232-a9ae-853ade231d42 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:38.314328 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d4a1da1b-45b6-4232-a9ae-853ade231d42 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:38.314985 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d4a1da1b-45b6-4232-a9ae-853ade231d42 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:38.517139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d4a1da1b-45b6-4232-a9ae-853ade231d42 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:38.529715 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d4a1da1b-45b6-4232-a9ae-853ade231d42 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.234324 Sep 15 07:41:38.531057 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 179/339] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:38 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:39.118662 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:39.120249 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:39.130398 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:39.134325 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:39.134325 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:39.134325 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:39.134325 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:39.134814 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:39.409118 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:39.427797 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:39.429216 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:39.430831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f7e6cb5c-97c1-434a-8651-99b749023aaa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.316975 Sep 15 07:41:39.431916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 161/340] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:39 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:39.557500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a6629c24-a8f6-4595-9728-ac1da5f0623f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:39.558174 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a6629c24-a8f6-4595-9728-ac1da5f0623f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:39.566453 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6629c24-a8f6-4595-9728-ac1da5f0623f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:39.566973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6629c24-a8f6-4595-9728-ac1da5f0623f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:39.567480 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6629c24-a8f6-4595-9728-ac1da5f0623f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:39.568250 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6629c24-a8f6-4595-9728-ac1da5f0623f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:39.568866 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6629c24-a8f6-4595-9728-ac1da5f0623f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:39.569079 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6629c24-a8f6-4595-9728-ac1da5f0623f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:39.596038 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:39.761854 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a6629c24-a8f6-4595-9728-ac1da5f0623f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:39.773621 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a6629c24-a8f6-4595-9728-ac1da5f0623f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.220421 Sep 15 07:41:39.782740 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 180/341] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:39 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:40.458476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:40.459346 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:40.465825 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:40.466374 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:40.467002 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:40.467593 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:40.468307 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:40.468464 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:40.630534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:40.641049 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:40.643671 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:40.645672 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0ed5f7cb-4447-49ea-9528-6c191f7403ed tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.191508 Sep 15 07:41:40.646529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 162/342] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:40 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:40.801571 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-509247a7-380f-4b4c-a696-1ab1353623c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:40.803091 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-509247a7-380f-4b4c-a696-1ab1353623c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:40.810759 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-509247a7-380f-4b4c-a696-1ab1353623c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:40.811497 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-509247a7-380f-4b4c-a696-1ab1353623c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:40.812108 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-509247a7-380f-4b4c-a696-1ab1353623c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:40.812777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-509247a7-380f-4b4c-a696-1ab1353623c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:40.813418 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-509247a7-380f-4b4c-a696-1ab1353623c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:40.814082 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-509247a7-380f-4b4c-a696-1ab1353623c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:40.997078 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-509247a7-380f-4b4c-a696-1ab1353623c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:41.006549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-509247a7-380f-4b4c-a696-1ab1353623c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.211094 Sep 15 07:41:41.007565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 181/343] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:40 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:41.680619 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:41.681251 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:41.689091 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:41.689604 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:41.690427 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:41.691338 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:41.691939 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:41.692543 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:41.851299 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:41.865336 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:41.868054 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:41.869528 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7c7cfcc4-4bf0-4c1c-9b20-2ba4f4fa50c7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.193823 Sep 15 07:41:41.871779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 163/344] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:41 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:42.035327 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-abb5b5c4-4582-425e-bf45-65128ac2d6a4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:42.035973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-abb5b5c4-4582-425e-bf45-65128ac2d6a4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:42.039463 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:42.052687 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-abb5b5c4-4582-425e-bf45-65128ac2d6a4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:42.053532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-abb5b5c4-4582-425e-bf45-65128ac2d6a4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:42.054174 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-abb5b5c4-4582-425e-bf45-65128ac2d6a4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:42.055094 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-abb5b5c4-4582-425e-bf45-65128ac2d6a4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:42.055918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-abb5b5c4-4582-425e-bf45-65128ac2d6a4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:42.056516 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-abb5b5c4-4582-425e-bf45-65128ac2d6a4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:42.214549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-abb5b5c4-4582-425e-bf45-65128ac2d6a4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:42.223838 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-abb5b5c4-4582-425e-bf45-65128ac2d6a4 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.196493 Sep 15 07:41:42.231062 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 182/345] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:42 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:42.913320 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:42.913998 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:42.922437 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:42.923151 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:42.923787 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:42.925976 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:42.926450 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:42.926894 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:43.081459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:43.110273 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:43.120878 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:43.122150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a9acfb49-4899-4054-bc22-b2ab80914d6f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.220338 Sep 15 07:41:43.122919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 164/346] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:42 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:43.257904 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9acc87aa-9edc-44d1-827a-666fe8daed44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:43.257904 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-9acc87aa-9edc-44d1-827a-666fe8daed44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:43.260723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9acc87aa-9edc-44d1-827a-666fe8daed44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:43.261216 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9acc87aa-9edc-44d1-827a-666fe8daed44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:43.261702 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9acc87aa-9edc-44d1-827a-666fe8daed44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:43.262368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9acc87aa-9edc-44d1-827a-666fe8daed44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:43.262991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9acc87aa-9edc-44d1-827a-666fe8daed44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:43.263478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9acc87aa-9edc-44d1-827a-666fe8daed44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:43.417285 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-9acc87aa-9edc-44d1-827a-666fe8daed44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:43.426512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9acc87aa-9edc-44d1-827a-666fe8daed44 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.176831 Sep 15 07:41:43.427394 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 165/347] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:43 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:43.435317 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-de4d4e3f-e2dc-4036-b91f-0386eecde517 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Action: 'create', calling method: .version_select at 0x7ff36ca9cd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1265932845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgRU9+GcQzsE6JTcKKfoMq+d8I4AbJvWURXMtWvyaO8Pz/GdWum8aSN1HTRVXx4tNa2i/wGGZIni6UynuRh3RWFRLHXqrZ6YXDFsA8M2sgepE/ozM8TkkF66FAj1Yjg4Q=="}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:43.451745 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-de4d4e3f-e2dc-4036-b91f-0386eecde517 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Getting quotas for project 7e20a6e5fded473c8905bffff7775ed3. Resources: {'key_pairs'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:41:43.456190 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-de4d4e3f-e2dc-4036-b91f-0386eecde517 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Getting quotas for user 0a1410abac494fd18c859268b528ec0c and project 7e20a6e5fded473c8905bffff7775ed3. Resources: {'key_pairs'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:41:43.557117 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-de4d4e3f-e2dc-4036-b91f-0386eecde517 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.312597 Sep 15 07:41:43.558036 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 183/348] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 15 07:41:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:41:44.148720 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:44.152905 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:44.155599 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:44.156082 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:44.156517 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:44.157206 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:44.157687 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:44.158133 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:44.325991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:44.333636 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:44.335202 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:44.336404 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f8d17a6d-a3c9-45ae-b6aa-3ba79fa94160 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.191575 Sep 15 07:41:44.337352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 166/349] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:44 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:44.450273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-21c4f3d6-b105-4121-9dbd-d6a579f938e6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:44.451753 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-21c4f3d6-b105-4121-9dbd-d6a579f938e6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:44.459429 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21c4f3d6-b105-4121-9dbd-d6a579f938e6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:44.460004 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21c4f3d6-b105-4121-9dbd-d6a579f938e6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:44.460446 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21c4f3d6-b105-4121-9dbd-d6a579f938e6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:44.461142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21c4f3d6-b105-4121-9dbd-d6a579f938e6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:44.461604 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21c4f3d6-b105-4121-9dbd-d6a579f938e6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:44.462034 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21c4f3d6-b105-4121-9dbd-d6a579f938e6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:44.833697 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-21c4f3d6-b105-4121-9dbd-d6a579f938e6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:44.844864 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-21c4f3d6-b105-4121-9dbd-d6a579f938e6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.395008 Sep 15 07:41:44.844864 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 184/350] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:44 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:45.364133 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:45.364760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:45.376303 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:45.376995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:45.378157 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:45.379030 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:45.379669 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:45.380254 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:45.401766 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=100 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:45.593830 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:45.609334 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:45.610230 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:45.612102 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-1d479c8d-1042-4ab3-8191-9f7ee74d9f15 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.252019 Sep 15 07:41:45.630909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 167/351] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:45 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:45.865490 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-877cacb2-bb3a-4606-a193-c046743ab169 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:45.866163 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-877cacb2-bb3a-4606-a193-c046743ab169 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:45.876044 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-877cacb2-bb3a-4606-a193-c046743ab169 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:45.878825 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-877cacb2-bb3a-4606-a193-c046743ab169 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:45.879275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-877cacb2-bb3a-4606-a193-c046743ab169 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:45.884504 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-877cacb2-bb3a-4606-a193-c046743ab169 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:45.884504 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-877cacb2-bb3a-4606-a193-c046743ab169 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:45.884504 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-877cacb2-bb3a-4606-a193-c046743ab169 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:46.129914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-877cacb2-bb3a-4606-a193-c046743ab169 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:46.142844 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-877cacb2-bb3a-4606-a193-c046743ab169 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.281604 Sep 15 07:41:46.146579 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 185/352] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:45 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:46.638322 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:46.644289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:46.651859 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:46.652354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:46.652963 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:46.653689 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:46.654143 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:46.654557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:46.829958 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:46.843405 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:46.844563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:46.845944 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-554e7b6c-b21a-4b27-833f-45df6fc26459 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.212198 Sep 15 07:41:46.847862 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 168/353] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:46 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:47.172346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b8acf64d-05f8-489c-b01b-04af4db7ce47 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:47.172723 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b8acf64d-05f8-489c-b01b-04af4db7ce47 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:47.182372 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8acf64d-05f8-489c-b01b-04af4db7ce47 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:47.182372 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8acf64d-05f8-489c-b01b-04af4db7ce47 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:47.182540 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8acf64d-05f8-489c-b01b-04af4db7ce47 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:47.185111 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8acf64d-05f8-489c-b01b-04af4db7ce47 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:47.187250 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8acf64d-05f8-489c-b01b-04af4db7ce47 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:47.187875 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8acf64d-05f8-489c-b01b-04af4db7ce47 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:47.340607 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b8acf64d-05f8-489c-b01b-04af4db7ce47 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:47.349063 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b8acf64d-05f8-489c-b01b-04af4db7ce47 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.181202 Sep 15 07:41:47.349639 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 186/354] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:47 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:47.872237 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:47.872844 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:47.879205 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:47.879687 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:47.880112 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:47.880798 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:47.881242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:47.881692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:48.016241 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:48.025669 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:48.027133 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:48.028301 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-94852fee-c0fe-4eb5-9aa0-fdc0fd4b1859 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.159972 Sep 15 07:41:48.029011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 169/355] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:47 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:48.372116 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-65df3f07-7835-4e16-8571-5becd769d677 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:48.372758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-65df3f07-7835-4e16-8571-5becd769d677 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:48.379888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-65df3f07-7835-4e16-8571-5becd769d677 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:48.380374 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-65df3f07-7835-4e16-8571-5becd769d677 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:48.380806 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-65df3f07-7835-4e16-8571-5becd769d677 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:48.381492 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-65df3f07-7835-4e16-8571-5becd769d677 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:48.382003 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-65df3f07-7835-4e16-8571-5becd769d677 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:48.382425 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-65df3f07-7835-4e16-8571-5becd769d677 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:48.457745 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-798290873", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2002691772", "security_groups": [{"name": "tempest-secgroup-smoke-1463350431"}], "block_device_mapping_v2": [{"uuid": "148c718c-4068-4a83-89a8-754b6397da7d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2c10a638-2533-4c87-88f1-ce4db4dec0fd"}]}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:48.521076 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-65df3f07-7835-4e16-8571-5becd769d677 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:48.527185 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-65df3f07-7835-4e16-8571-5becd769d677 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.158908 Sep 15 07:41:48.527746 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 187/356] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:48 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:48.579293 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] validate_networks() for [('2c10a638-2533-4c87-88f1-ce4db4dec0fd', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:41:48.945163 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:41:48.945817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:41:48.946354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:41:48.946975 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:41:48.947565 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:41:48.957079 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:48.957698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:48.958230 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:48.959027 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:48.959836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:48.960263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:48.978634 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Getting quotas for project af1e008c4bfa41e18488c63ea0f17b27. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:41:48.982914 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Getting quotas for user ebd85e42855448268c89a200f4392316 and project af1e008c4bfa41e18488c63ea0f17b27. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:41:49.046724 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:41:49.049023 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='148c718c-4068-4a83-89a8-754b6397da7d',volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:41:49.057262 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:49.057905 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:49.065261 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:49.070709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:49.070709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:49.070709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:49.070709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:49.071118 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:49.206722 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:49.215339 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:49.216791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:49.218053 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0fd692ac-5375-4482-ad0f-137c476ce653 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.165513 Sep 15 07:41:49.218607 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 188/357] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:49 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:49.382609 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2624a676-2a25-4d5b-9c4e-8c832f11f061 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.929311 Sep 15 07:41:49.383264 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 170/358] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:41:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 07:41:49.396950 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0f20d46d-6e7b-4d82-9458-c3c6437baf25 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:49.397681 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0f20d46d-6e7b-4d82-9458-c3c6437baf25 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:49.452232 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0f20d46d-6e7b-4d82-9458-c3c6437baf25 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:49.461324 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0f20d46d-6e7b-4d82-9458-c3c6437baf25 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1094 microversion: 2.1 time: 0.069540 Sep 15 07:41:49.461928 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 189/359] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:49 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:49.551401 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-daabd544-99ed-4725-8b1d-143a4b95e70a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:49.552019 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-daabd544-99ed-4725-8b1d-143a4b95e70a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:49.559720 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-daabd544-99ed-4725-8b1d-143a4b95e70a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:49.560219 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-daabd544-99ed-4725-8b1d-143a4b95e70a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:49.560657 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-daabd544-99ed-4725-8b1d-143a4b95e70a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:49.561548 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-daabd544-99ed-4725-8b1d-143a4b95e70a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:49.562027 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-daabd544-99ed-4725-8b1d-143a4b95e70a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:49.562454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-daabd544-99ed-4725-8b1d-143a4b95e70a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:49.700856 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-daabd544-99ed-4725-8b1d-143a4b95e70a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:49.709432 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-daabd544-99ed-4725-8b1d-143a4b95e70a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.162473 Sep 15 07:41:49.710036 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 171/360] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:49 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:50.244803 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:50.245541 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:50.251574 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:50.252056 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:50.252486 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:50.253822 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:50.254271 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:50.254686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:50.485012 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-81836919-44ba-4a16-bddd-9ab68bab085b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:50.486359 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-81836919-44ba-4a16-bddd-9ab68bab085b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:50.493600 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-81836919-44ba-4a16-bddd-9ab68bab085b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:50.494198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-81836919-44ba-4a16-bddd-9ab68bab085b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:50.494992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-81836919-44ba-4a16-bddd-9ab68bab085b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:50.495940 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:50.496739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-81836919-44ba-4a16-bddd-9ab68bab085b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:50.497299 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-81836919-44ba-4a16-bddd-9ab68bab085b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:50.497919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-81836919-44ba-4a16-bddd-9ab68bab085b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:50.508938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:50.510839 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:50.512350 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3ffb932f-c779-475a-a089-29ffde1bfe64 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.271688 Sep 15 07:41:50.513362 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 190/361] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:50 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:50.596385 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-81836919-44ba-4a16-bddd-9ab68bab085b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:50.605836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-81836919-44ba-4a16-bddd-9ab68bab085b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1144 microversion: 2.1 time: 0.125561 Sep 15 07:41:50.606490 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 172/362] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:50 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1144 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:50.736564 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e6f9870b-16a1-4f52-87fa-93e72111fccc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:50.746622 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e6f9870b-16a1-4f52-87fa-93e72111fccc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:50.755457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6f9870b-16a1-4f52-87fa-93e72111fccc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:50.756390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6f9870b-16a1-4f52-87fa-93e72111fccc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:50.757078 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6f9870b-16a1-4f52-87fa-93e72111fccc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:50.758298 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6f9870b-16a1-4f52-87fa-93e72111fccc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:50.758971 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6f9870b-16a1-4f52-87fa-93e72111fccc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:50.759612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6f9870b-16a1-4f52-87fa-93e72111fccc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:50.773760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-23c5cbb1-f1c0-499f-a0a4-e3256afd8dc8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:50.774295 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-23c5cbb1-f1c0-499f-a0a4-e3256afd8dc8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:50.792519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23c5cbb1-f1c0-499f-a0a4-e3256afd8dc8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:50.793058 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23c5cbb1-f1c0-499f-a0a4-e3256afd8dc8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:50.793501 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23c5cbb1-f1c0-499f-a0a4-e3256afd8dc8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:50.794350 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23c5cbb1-f1c0-499f-a0a4-e3256afd8dc8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:50.794802 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23c5cbb1-f1c0-499f-a0a4-e3256afd8dc8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:50.797862 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23c5cbb1-f1c0-499f-a0a4-e3256afd8dc8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:50.848076 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-23c5cbb1-f1c0-499f-a0a4-e3256afd8dc8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967/ips" status: 200 len: 150 microversion: 2.1 time: 0.082139 Sep 15 07:41:50.849383 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 173/363] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 15 07:41:50 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967/ips => generated 150 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:41:50.860159 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-075d2a8b-54bd-4102-a71c-293e1c152e75 req-911ec6e4-58ae-4cf6-affb-0ce7c386773a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ae2103-9abb-45d7-94b1-7e0f83c44fa0", "name": "network-vif-plugged", "status": "completed", "tag": "60114f49-493e-46b0-a653-b05d4362ebe7"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:50.870720 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-075d2a8b-54bd-4102-a71c-293e1c152e75 req-911ec6e4-58ae-4cf6-affb-0ce7c386773a service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:50.871277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-075d2a8b-54bd-4102-a71c-293e1c152e75 req-911ec6e4-58ae-4cf6-affb-0ce7c386773a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:50.871883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-075d2a8b-54bd-4102-a71c-293e1c152e75 req-911ec6e4-58ae-4cf6-affb-0ce7c386773a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:50.884953 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-075d2a8b-54bd-4102-a71c-293e1c152e75 req-911ec6e4-58ae-4cf6-affb-0ce7c386773a service nova] Creating event network-vif-plugged:60114f49-493e-46b0-a653-b05d4362ebe7 for instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 on hv-cinder-82414 Sep 15 07:41:50.890176 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-075d2a8b-54bd-4102-a71c-293e1c152e75 req-911ec6e4-58ae-4cf6-affb-0ce7c386773a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039396 Sep 15 07:41:50.890879 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 174/364] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:41:50.897510 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acc6d41d-3822-431f-bff8-c8b34f88bfc4"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:50.899936 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:50.906361 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:50.906855 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:50.907299 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:50.908001 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:50.908459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:50.908884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:51.013478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Invalid volume: volume acc6d41d-3822-431f-bff8-c8b34f88bfc4 is already attached to instances: 37cd67df-dd0e-4658-9b80-3c29efd65897 Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: POST /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967/os-volume_attachments HTTP/1.1 Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 74 Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:41:51.015611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {"volumeAttachment": {"volumeId": "acc6d41d-3822-431f-bff8-c8b34f88bfc4"}} Sep 15 07:41:51.017174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Invalid volume: volume acc6d41d-3822-431f-bff8-c8b34f88bfc4 is already attached to instances: 37cd67df-dd0e-4658-9b80-3c29efd65897 Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'server_id': '95c6ee4c-f348-424e-9fa6-ca2ee2f67967', 'body': {'volumeAttachment': {'volumeId': 'acc6d41d-3822-431f-bff8-c8b34f88bfc4'}}} Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume acc6d41d-3822-431f-bff8-c8b34f88bfc4 is already attached to instances: 37cd67df-dd0e-4658-9b80-3c29efd65897 Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:41:51.018099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume acc6d41d-3822-431f-bff8-c8b34f88bfc4 is already attached to instances: 37cd67df-dd0e-4658-9b80-3c29efd65897 Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:41:51.019869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:41:51.021003 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:41:51.021003 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:41:51.021003 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:41:51.021003 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume acc6d41d-3822-431f-bff8-c8b34f88bfc4 is already attached to instances: 37cd67df-dd0e-4658-9b80-3c29efd65897 Sep 15 07:41:51.021003 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:41:51.021003 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 400 to user: Invalid volume: volume acc6d41d-3822-431f-bff8-c8b34f88bfc4 is already attached to instances: 37cd67df-dd0e-4658-9b80-3c29efd65897 {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:41:51.021003 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4c5de828-eb8d-4428-8767-ea16546c2ce4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.124844 Sep 15 07:41:51.021003 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 175/365] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:41:50 2022] POST /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 07:41:51.027234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-55521b49-a597-4c34-b01b-65b9dc282f09 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:51.027739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-55521b49-a597-4c34-b01b-65b9dc282f09 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:51.043128 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e6f9870b-16a1-4f52-87fa-93e72111fccc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:51.043386 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-55521b49-a597-4c34-b01b-65b9dc282f09 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:51.043386 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-55521b49-a597-4c34-b01b-65b9dc282f09 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:51.043386 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-55521b49-a597-4c34-b01b-65b9dc282f09 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:51.043386 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-55521b49-a597-4c34-b01b-65b9dc282f09 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:51.043742 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-55521b49-a597-4c34-b01b-65b9dc282f09 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:51.043742 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-55521b49-a597-4c34-b01b-65b9dc282f09 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:51.043875 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e6f9870b-16a1-4f52-87fa-93e72111fccc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.310444 Sep 15 07:41:51.043875 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 191/366] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:50 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:51.066593 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-55521b49-a597-4c34-b01b-65b9dc282f09 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Going to try to terminate instance {{(pid=132673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:41:51.382836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-55521b49-a597-4c34-b01b-65b9dc282f09 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 204 len: 0 microversion: 2.1 time: 0.358434 Sep 15 07:41:51.386173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 176/367] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:41:51 2022] DELETE /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 07:41:51.395759 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6fe331b5-f979-45c7-9cad-4132fff8ada5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:51.396371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6fe331b5-f979-45c7-9cad-4132fff8ada5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:51.402624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fe331b5-f979-45c7-9cad-4132fff8ada5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:51.403109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fe331b5-f979-45c7-9cad-4132fff8ada5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:51.403544 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fe331b5-f979-45c7-9cad-4132fff8ada5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:51.404244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fe331b5-f979-45c7-9cad-4132fff8ada5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:51.404691 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fe331b5-f979-45c7-9cad-4132fff8ada5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:51.406256 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fe331b5-f979-45c7-9cad-4132fff8ada5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:51.541329 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:51.542253 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:51.550454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:51.550941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:51.551594 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:51.552296 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:51.552905 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:51.553483 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:51.567790 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6fe331b5-f979-45c7-9cad-4132fff8ada5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:51.576842 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6fe331b5-f979-45c7-9cad-4132fff8ada5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1682 microversion: 2.1 time: 0.185648 Sep 15 07:41:51.577967 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 192/368] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:51 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:51.629842 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-be394b91-8e41-4739-93c5-e9da2e4dcbc8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:51.630529 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-be394b91-8e41-4739-93c5-e9da2e4dcbc8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:51.636563 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be394b91-8e41-4739-93c5-e9da2e4dcbc8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:51.636910 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be394b91-8e41-4739-93c5-e9da2e4dcbc8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:51.637350 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be394b91-8e41-4739-93c5-e9da2e4dcbc8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:51.638076 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be394b91-8e41-4739-93c5-e9da2e4dcbc8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:51.638528 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be394b91-8e41-4739-93c5-e9da2e4dcbc8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:51.638950 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be394b91-8e41-4739-93c5-e9da2e4dcbc8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:51.707712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-be394b91-8e41-4739-93c5-e9da2e4dcbc8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:51.715899 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-be394b91-8e41-4739-93c5-e9da2e4dcbc8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1192 microversion: 2.1 time: 0.090423 Sep 15 07:41:51.716471 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 193/369] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:51 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:51.723482 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:51.732198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:51.733749 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:51.734912 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2ae2084a-cf3d-4ed6-8d3f-c56f7e791d9a tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.198900 Sep 15 07:41:51.735468 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 177/370] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:51 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:52.079523 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3b168baf-1256-4265-a4d6-d16725b028c8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:52.080187 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3b168baf-1256-4265-a4d6-d16725b028c8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:52.088468 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3b168baf-1256-4265-a4d6-d16725b028c8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:52.089139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3b168baf-1256-4265-a4d6-d16725b028c8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:52.089620 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3b168baf-1256-4265-a4d6-d16725b028c8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:52.090349 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3b168baf-1256-4265-a4d6-d16725b028c8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:52.090811 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3b168baf-1256-4265-a4d6-d16725b028c8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:52.091245 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3b168baf-1256-4265-a4d6-d16725b028c8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:52.221343 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3b168baf-1256-4265-a4d6-d16725b028c8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:52.229369 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3b168baf-1256-4265-a4d6-d16725b028c8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.158191 Sep 15 07:41:52.229959 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 194/371] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:52 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:52.600465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5b236678-e2f6-4730-8d14-49c26ae273a9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:52.601084 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5b236678-e2f6-4730-8d14-49c26ae273a9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:52.607522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b236678-e2f6-4730-8d14-49c26ae273a9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:52.608039 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b236678-e2f6-4730-8d14-49c26ae273a9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:52.608478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b236678-e2f6-4730-8d14-49c26ae273a9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:52.609164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b236678-e2f6-4730-8d14-49c26ae273a9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:52.609650 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b236678-e2f6-4730-8d14-49c26ae273a9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:52.610087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b236678-e2f6-4730-8d14-49c26ae273a9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:52.739367 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f1c3a307-13bc-4e34-8a6d-cef763d5582f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:52.739979 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f1c3a307-13bc-4e34-8a6d-cef763d5582f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:52.740155 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5b236678-e2f6-4730-8d14-49c26ae273a9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:52.746477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1c3a307-13bc-4e34-8a6d-cef763d5582f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:52.746954 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1c3a307-13bc-4e34-8a6d-cef763d5582f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:52.747385 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1c3a307-13bc-4e34-8a6d-cef763d5582f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:52.747954 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5b236678-e2f6-4730-8d14-49c26ae273a9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1682 microversion: 2.1 time: 0.151603 Sep 15 07:41:52.748105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1c3a307-13bc-4e34-8a6d-cef763d5582f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:52.748500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1c3a307-13bc-4e34-8a6d-cef763d5582f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:52.748622 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 178/372] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:52 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:52.749002 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1c3a307-13bc-4e34-8a6d-cef763d5582f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:52.759946 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:52.760641 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:52.766620 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:52.767103 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:52.767534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:52.768225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:52.769328 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:52.769804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:52.814064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f1c3a307-13bc-4e34-8a6d-cef763d5582f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:52.822601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f1c3a307-13bc-4e34-8a6d-cef763d5582f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1192 microversion: 2.1 time: 0.086982 Sep 15 07:41:52.823184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 195/373] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:52 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:52.905321 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:52.914788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:52.916230 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:52.917383 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7f80e602-ffb7-437c-a6a3-52f8ff4ef855 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.161212 Sep 15 07:41:52.917962 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 179/374] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:52 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:53.253434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-123a0ef4-534a-4c76-bdc2-e713c4d3e574 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:53.254070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-123a0ef4-534a-4c76-bdc2-e713c4d3e574 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:53.260016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-123a0ef4-534a-4c76-bdc2-e713c4d3e574 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:53.260490 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-123a0ef4-534a-4c76-bdc2-e713c4d3e574 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:53.260918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-123a0ef4-534a-4c76-bdc2-e713c4d3e574 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:53.261605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-123a0ef4-534a-4c76-bdc2-e713c4d3e574 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:53.262057 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-123a0ef4-534a-4c76-bdc2-e713c4d3e574 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:53.262469 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-123a0ef4-534a-4c76-bdc2-e713c4d3e574 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:53.390413 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-123a0ef4-534a-4c76-bdc2-e713c4d3e574 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:53.398637 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-123a0ef4-534a-4c76-bdc2-e713c4d3e574 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.148989 Sep 15 07:41:53.399191 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 196/375] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:53 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:53.772233 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ae9fde29-f0fe-40f4-8d2b-f38dd4c7af3c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:53.772850 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ae9fde29-f0fe-40f4-8d2b-f38dd4c7af3c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:53.779042 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae9fde29-f0fe-40f4-8d2b-f38dd4c7af3c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:53.779533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae9fde29-f0fe-40f4-8d2b-f38dd4c7af3c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:53.779968 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae9fde29-f0fe-40f4-8d2b-f38dd4c7af3c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:53.780724 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae9fde29-f0fe-40f4-8d2b-f38dd4c7af3c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:53.781184 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae9fde29-f0fe-40f4-8d2b-f38dd4c7af3c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:53.781631 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae9fde29-f0fe-40f4-8d2b-f38dd4c7af3c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:53.846151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6352cdfc-2c11-4a8a-898a-8f00b6499cf1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:53.847957 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6352cdfc-2c11-4a8a-898a-8f00b6499cf1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:53.858859 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6352cdfc-2c11-4a8a-898a-8f00b6499cf1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:53.859632 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6352cdfc-2c11-4a8a-898a-8f00b6499cf1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:53.860307 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6352cdfc-2c11-4a8a-898a-8f00b6499cf1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:53.861631 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6352cdfc-2c11-4a8a-898a-8f00b6499cf1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:53.862095 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6352cdfc-2c11-4a8a-898a-8f00b6499cf1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:53.863396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6352cdfc-2c11-4a8a-898a-8f00b6499cf1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:53.923830 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ae9fde29-f0fe-40f4-8d2b-f38dd4c7af3c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:53.932543 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ae9fde29-f0fe-40f4-8d2b-f38dd4c7af3c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1682 microversion: 2.1 time: 0.164910 Sep 15 07:41:53.933109 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 180/376] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:53 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:53.943263 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6352cdfc-2c11-4a8a-898a-8f00b6499cf1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:53.943733 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:53.944619 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:53.952157 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:53.952481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6352cdfc-2c11-4a8a-898a-8f00b6499cf1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1192 microversion: 2.1 time: 0.110310 Sep 15 07:41:53.952871 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:53.953055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 197/377] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:53 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:53.953673 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:53.954407 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:53.954856 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:53.955271 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:54.099523 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:54.107899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:54.109324 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:54.110551 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-08b5a076-be54-4a85-b391-1e0917e23328 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.171561 Sep 15 07:41:54.111107 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 181/378] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:53 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:54.424354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-707603ab-52dd-43f4-9e09-ea9da33b6c9b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:54.425694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-707603ab-52dd-43f4-9e09-ea9da33b6c9b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:54.432252 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-707603ab-52dd-43f4-9e09-ea9da33b6c9b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:54.432773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-707603ab-52dd-43f4-9e09-ea9da33b6c9b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:54.433242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-707603ab-52dd-43f4-9e09-ea9da33b6c9b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:54.434040 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-707603ab-52dd-43f4-9e09-ea9da33b6c9b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:54.434526 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-707603ab-52dd-43f4-9e09-ea9da33b6c9b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:54.435031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-707603ab-52dd-43f4-9e09-ea9da33b6c9b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:54.568339 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-707603ab-52dd-43f4-9e09-ea9da33b6c9b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:54.571793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:54.576734 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-707603ab-52dd-43f4-9e09-ea9da33b6c9b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.156185 Sep 15 07:41:54.577331 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 198/379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:54 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:54.956880 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-12c1c201-fadb-457e-8515-575344522808 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:54.957570 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-12c1c201-fadb-457e-8515-575344522808 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:54.964206 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12c1c201-fadb-457e-8515-575344522808 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:54.964698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12c1c201-fadb-457e-8515-575344522808 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:54.965139 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12c1c201-fadb-457e-8515-575344522808 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:54.965864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12c1c201-fadb-457e-8515-575344522808 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:54.966319 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12c1c201-fadb-457e-8515-575344522808 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:54.966744 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12c1c201-fadb-457e-8515-575344522808 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:54.981903 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-81b80f36-c77d-4d3c-b971-b29a52a53352 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:54.982848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-81b80f36-c77d-4d3c-b971-b29a52a53352 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:54.990084 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-81b80f36-c77d-4d3c-b971-b29a52a53352 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:54.990795 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-81b80f36-c77d-4d3c-b971-b29a52a53352 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:54.991228 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-81b80f36-c77d-4d3c-b971-b29a52a53352 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:54.991928 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-81b80f36-c77d-4d3c-b971-b29a52a53352 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:54.992379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-81b80f36-c77d-4d3c-b971-b29a52a53352 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:54.992852 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-81b80f36-c77d-4d3c-b971-b29a52a53352 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:55.079042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-81b80f36-c77d-4d3c-b971-b29a52a53352 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:55.093644 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-81b80f36-c77d-4d3c-b971-b29a52a53352 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1192 microversion: 2.1 time: 0.120405 Sep 15 07:41:55.094239 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 199/380] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:54 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1192 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:55.136578 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:55.137184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:55.138704 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-12c1c201-fadb-457e-8515-575344522808 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:55.143867 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:55.144309 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:55.144750 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:55.145489 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:55.146053 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:55.146483 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:55.148927 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-12c1c201-fadb-457e-8515-575344522808 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1682 microversion: 2.1 time: 0.196475 Sep 15 07:41:55.150069 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 182/381] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:54 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:55.325825 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:55.334680 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:55.336117 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:55.337776 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a2ec3702-06e8-4a2a-8278-b27574b4bd7c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.204779 Sep 15 07:41:55.337894 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 200/382] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:55 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:55.599945 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-14c5c344-d59d-4b28-9e46-0a531e1626c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:55.600562 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-14c5c344-d59d-4b28-9e46-0a531e1626c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:55.606531 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14c5c344-d59d-4b28-9e46-0a531e1626c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:55.607047 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14c5c344-d59d-4b28-9e46-0a531e1626c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:55.607486 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14c5c344-d59d-4b28-9e46-0a531e1626c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:55.608172 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14c5c344-d59d-4b28-9e46-0a531e1626c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:55.609052 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14c5c344-d59d-4b28-9e46-0a531e1626c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:55.609052 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14c5c344-d59d-4b28-9e46-0a531e1626c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:55.745766 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-14c5c344-d59d-4b28-9e46-0a531e1626c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:55.754300 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-14c5c344-d59d-4b28-9e46-0a531e1626c6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.157502 Sep 15 07:41:55.754901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 183/383] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:55 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:56.119396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ba41844a-f666-4da5-94d9-ac002ea09c40 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:56.120019 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ba41844a-f666-4da5-94d9-ac002ea09c40 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:56.126676 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba41844a-f666-4da5-94d9-ac002ea09c40 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:56.127150 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba41844a-f666-4da5-94d9-ac002ea09c40 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:56.127596 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba41844a-f666-4da5-94d9-ac002ea09c40 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:56.128322 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba41844a-f666-4da5-94d9-ac002ea09c40 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:56.128961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba41844a-f666-4da5-94d9-ac002ea09c40 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:56.129172 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba41844a-f666-4da5-94d9-ac002ea09c40 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:56.178901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-655f581e-8d1f-4691-b794-fe2b12c18bf4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:56.179514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-655f581e-8d1f-4691-b794-fe2b12c18bf4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:56.186061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-655f581e-8d1f-4691-b794-fe2b12c18bf4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:56.186544 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-655f581e-8d1f-4691-b794-fe2b12c18bf4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:56.186982 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-655f581e-8d1f-4691-b794-fe2b12c18bf4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:56.187673 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-655f581e-8d1f-4691-b794-fe2b12c18bf4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:56.188326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-655f581e-8d1f-4691-b794-fe2b12c18bf4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:56.188755 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-655f581e-8d1f-4691-b794-fe2b12c18bf4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:56.192095 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ba41844a-f666-4da5-94d9-ac002ea09c40 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:56.193526 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:56.201472 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ba41844a-f666-4da5-94d9-ac002ea09c40 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1192 microversion: 2.1 time: 0.086067 Sep 15 07:41:56.205747 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 201/384] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:56 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:56.341223 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-655f581e-8d1f-4691-b794-fe2b12c18bf4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:56.349074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-655f581e-8d1f-4691-b794-fe2b12c18bf4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1682 microversion: 2.1 time: 0.175194 Sep 15 07:41:56.349654 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 184/385] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:56 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:41:56.362102 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:56.363220 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:56.369176 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:56.369722 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:56.370153 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:56.370827 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:56.371276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:56.371693 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:56.498847 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:56.508452 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:56.510061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:56.511222 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-721956d9-b3d7-41b1-ad0e-744dd436023c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.153097 Sep 15 07:41:56.511773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 202/386] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:56 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:41:56.777730 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-93504f4f-7244-449b-8891-46bb51577e73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:56.778262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-93504f4f-7244-449b-8891-46bb51577e73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:56.784588 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93504f4f-7244-449b-8891-46bb51577e73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:56.785273 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93504f4f-7244-449b-8891-46bb51577e73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:56.785729 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93504f4f-7244-449b-8891-46bb51577e73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:56.786682 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93504f4f-7244-449b-8891-46bb51577e73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:56.787133 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93504f4f-7244-449b-8891-46bb51577e73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:56.787556 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93504f4f-7244-449b-8891-46bb51577e73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:56.919092 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-93504f4f-7244-449b-8891-46bb51577e73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:56.927289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-93504f4f-7244-449b-8891-46bb51577e73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.153521 Sep 15 07:41:56.927850 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 185/387] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:56 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:57.226383 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b855e723-d057-460c-9616-5ca2abf70599 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:57.226993 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b855e723-d057-460c-9616-5ca2abf70599 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:57.235886 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b855e723-d057-460c-9616-5ca2abf70599 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:57.236365 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b855e723-d057-460c-9616-5ca2abf70599 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:57.236795 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b855e723-d057-460c-9616-5ca2abf70599 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:57.237512 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b855e723-d057-460c-9616-5ca2abf70599 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:57.237971 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b855e723-d057-460c-9616-5ca2abf70599 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:57.238416 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b855e723-d057-460c-9616-5ca2abf70599 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:57.301019 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b855e723-d057-460c-9616-5ca2abf70599 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:57.308637 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b855e723-d057-460c-9616-5ca2abf70599 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1192 microversion: 2.1 time: 0.087059 Sep 15 07:41:57.309196 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 203/388] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:57 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:57.373222 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-178f9cd3-fc04-43d9-9c65-8401c6d3a0fd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:57.373860 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-178f9cd3-fc04-43d9-9c65-8401c6d3a0fd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:57.381465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-178f9cd3-fc04-43d9-9c65-8401c6d3a0fd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:57.381984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-178f9cd3-fc04-43d9-9c65-8401c6d3a0fd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:57.382417 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-178f9cd3-fc04-43d9-9c65-8401c6d3a0fd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:57.383109 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-178f9cd3-fc04-43d9-9c65-8401c6d3a0fd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:57.383563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-178f9cd3-fc04-43d9-9c65-8401c6d3a0fd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:57.383986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-178f9cd3-fc04-43d9-9c65-8401c6d3a0fd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:57.522854 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-178f9cd3-fc04-43d9-9c65-8401c6d3a0fd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:57.530797 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-178f9cd3-fc04-43d9-9c65-8401c6d3a0fd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1682 microversion: 2.1 time: 0.161361 Sep 15 07:41:57.531373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 186/389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:57 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:57.538232 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:57.538871 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:57.545070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:57.545555 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:57.546020 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:57.546716 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:57.547174 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:57.547600 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:57.680857 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:57.689612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:57.691306 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:57.692569 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a583325e-8fbb-4eef-86d5-bb8e79449b51 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.159307 Sep 15 07:41:57.693133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 204/390] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:57 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:57.951359 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-627d8d42-44eb-43d9-9a03-70a4acba3fc2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:57.951944 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-627d8d42-44eb-43d9-9a03-70a4acba3fc2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:57.959091 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-627d8d42-44eb-43d9-9a03-70a4acba3fc2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:57.959810 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-627d8d42-44eb-43d9-9a03-70a4acba3fc2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:57.960253 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-627d8d42-44eb-43d9-9a03-70a4acba3fc2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:57.960963 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-627d8d42-44eb-43d9-9a03-70a4acba3fc2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:57.961414 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-627d8d42-44eb-43d9-9a03-70a4acba3fc2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:57.961870 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-627d8d42-44eb-43d9-9a03-70a4acba3fc2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:58.094991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-627d8d42-44eb-43d9-9a03-70a4acba3fc2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:58.102850 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-627d8d42-44eb-43d9-9a03-70a4acba3fc2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.155450 Sep 15 07:41:58.103409 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 187/391] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:57 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:58.334974 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c34c25f1-f011-43b3-b528-b95fa44ec297 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:58.335585 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c34c25f1-f011-43b3-b528-b95fa44ec297 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:58.341930 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c34c25f1-f011-43b3-b528-b95fa44ec297 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:58.342415 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c34c25f1-f011-43b3-b528-b95fa44ec297 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:58.342858 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c34c25f1-f011-43b3-b528-b95fa44ec297 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:58.343535 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c34c25f1-f011-43b3-b528-b95fa44ec297 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:58.343987 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c34c25f1-f011-43b3-b528-b95fa44ec297 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:58.344414 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c34c25f1-f011-43b3-b528-b95fa44ec297 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:58.404704 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c34c25f1-f011-43b3-b528-b95fa44ec297 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:58.414425 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c34c25f1-f011-43b3-b528-b95fa44ec297 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1192 microversion: 2.1 time: 0.083600 Sep 15 07:41:58.415039 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 205/392] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:58 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:58.556444 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-fa1f28c3-44b7-4114-b648-a08e5ee1e296 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:58.557053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-fa1f28c3-44b7-4114-b648-a08e5ee1e296 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:58.563718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1f28c3-44b7-4114-b648-a08e5ee1e296 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:58.564197 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1f28c3-44b7-4114-b648-a08e5ee1e296 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:58.564629 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1f28c3-44b7-4114-b648-a08e5ee1e296 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:58.565350 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1f28c3-44b7-4114-b648-a08e5ee1e296 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:58.565886 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1f28c3-44b7-4114-b648-a08e5ee1e296 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:58.566423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1f28c3-44b7-4114-b648-a08e5ee1e296 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:58.695642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fa1f28c3-44b7-4114-b648-a08e5ee1e296 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:58.704043 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-fa1f28c3-44b7-4114-b648-a08e5ee1e296 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1682 microversion: 2.1 time: 0.151362 Sep 15 07:41:58.704644 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 188/393] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:58 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:58.718031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:58.718675 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:58.726045 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:58.726530 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:58.726979 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:58.727682 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:58.728134 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:58.728556 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:58.856699 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:58.865346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:58.866813 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:58.867959 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-783a3c07-e4a1-4c06-a9d3-e1df0b7bfb1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.153921 Sep 15 07:41:58.868510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 206/394] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:58 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:41:59.125557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-66c95557-41a0-4632-b22e-37cae385cf85 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:59.126184 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-66c95557-41a0-4632-b22e-37cae385cf85 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:59.127992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:59.129454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=6 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:59.134216 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-66c95557-41a0-4632-b22e-37cae385cf85 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:59.134651 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-66c95557-41a0-4632-b22e-37cae385cf85 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:59.135078 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-66c95557-41a0-4632-b22e-37cae385cf85 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:59.135756 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-66c95557-41a0-4632-b22e-37cae385cf85 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:59.136204 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-66c95557-41a0-4632-b22e-37cae385cf85 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:59.136617 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-66c95557-41a0-4632-b22e-37cae385cf85 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:59.270591 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-66c95557-41a0-4632-b22e-37cae385cf85 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:59.278370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-66c95557-41a0-4632-b22e-37cae385cf85 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.156653 Sep 15 07:41:59.278944 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 189/395] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:59 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:59.439493 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-47055c36-70bf-4318-8c72-98ab26572827 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:59.440046 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-47055c36-70bf-4318-8c72-98ab26572827 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:59.447214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47055c36-70bf-4318-8c72-98ab26572827 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:59.447693 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47055c36-70bf-4318-8c72-98ab26572827 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:59.448131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47055c36-70bf-4318-8c72-98ab26572827 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:59.448816 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47055c36-70bf-4318-8c72-98ab26572827 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:59.449266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47055c36-70bf-4318-8c72-98ab26572827 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:59.449729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47055c36-70bf-4318-8c72-98ab26572827 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:59.464918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=6 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:41:59.512886 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-47055c36-70bf-4318-8c72-98ab26572827 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:59.521528 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-47055c36-70bf-4318-8c72-98ab26572827 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1192 microversion: 2.1 time: 0.086013 Sep 15 07:41:59.523078 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 207/396] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:59 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:59.732750 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-64f786e9-cdaa-4843-9673-2ca82d49e021 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:59.732750 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-64f786e9-cdaa-4843-9673-2ca82d49e021 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:59.736106 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64f786e9-cdaa-4843-9673-2ca82d49e021 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:59.736607 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64f786e9-cdaa-4843-9673-2ca82d49e021 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:59.737045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64f786e9-cdaa-4843-9673-2ca82d49e021 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:59.737971 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64f786e9-cdaa-4843-9673-2ca82d49e021 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:59.738834 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64f786e9-cdaa-4843-9673-2ca82d49e021 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:59.739235 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-64f786e9-cdaa-4843-9673-2ca82d49e021 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:59.876332 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-7beabc70-f069-4508-81a4-cec4f2d429dc req-96cc4d46-1b7f-4027-9923-3b93f14f7842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c6ee4c-f348-424e-9fa6-ca2ee2f67967", "name": "network-vif-unplugged", "status": "completed", "tag": "3b7d0375-a226-4e4b-a78f-fde982eb4c97"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:41:59.884229 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-64f786e9-cdaa-4843-9673-2ca82d49e021 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:41:59.897178 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-64f786e9-cdaa-4843-9673-2ca82d49e021 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1682 microversion: 2.1 time: 0.172684 Sep 15 07:41:59.898124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 190/397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:41:59 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:41:59.907696 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-7beabc70-f069-4508-81a4-cec4f2d429dc req-96cc4d46-1b7f-4027-9923-3b93f14f7842 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:59.908438 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-7beabc70-f069-4508-81a4-cec4f2d429dc req-96cc4d46-1b7f-4027-9923-3b93f14f7842 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:59.908807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:41:59.909244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-7beabc70-f069-4508-81a4-cec4f2d429dc req-96cc4d46-1b7f-4027-9923-3b93f14f7842 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:59.909727 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:41:59.916959 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:59.917465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:59.918129 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:59.918903 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:41:59.919472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:41:59.920093 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:41:59.928728 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-7beabc70-f069-4508-81a4-cec4f2d429dc req-96cc4d46-1b7f-4027-9923-3b93f14f7842 service nova] Creating event network-vif-unplugged:3b7d0375-a226-4e4b-a78f-fde982eb4c97 for instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 on hv-cinder-82414 Sep 15 07:41:59.935640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-7beabc70-f069-4508-81a4-cec4f2d429dc req-96cc4d46-1b7f-4027-9923-3b93f14f7842 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064516 Sep 15 07:41:59.952236 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 208/398] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:42:00.061379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:00.070837 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:00.072401 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:00.073904 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-57f72f82-44c0-40f4-9259-181ee559ebfa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.174644 Sep 15 07:42:00.074534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 191/399] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:41:59 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:42:00.305880 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6c4f1392-165d-4242-b374-4479d807dd21 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:00.306765 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6c4f1392-165d-4242-b374-4479d807dd21 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:00.313694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c4f1392-165d-4242-b374-4479d807dd21 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:00.314258 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c4f1392-165d-4242-b374-4479d807dd21 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:00.314921 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c4f1392-165d-4242-b374-4479d807dd21 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:00.316064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c4f1392-165d-4242-b374-4479d807dd21 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:00.316749 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c4f1392-165d-4242-b374-4479d807dd21 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:00.317240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c4f1392-165d-4242-b374-4479d807dd21 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:00.461319 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6c4f1392-165d-4242-b374-4479d807dd21 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:00.469552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6c4f1392-165d-4242-b374-4479d807dd21 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.168311 Sep 15 07:42:00.472719 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 209/400] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:00 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:00.560103 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c04f4867-db76-4f16-a45b-9e5926704aab tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:00.562726 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c04f4867-db76-4f16-a45b-9e5926704aab tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:00.570065 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c04f4867-db76-4f16-a45b-9e5926704aab tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:00.571114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c04f4867-db76-4f16-a45b-9e5926704aab tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:00.571584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c04f4867-db76-4f16-a45b-9e5926704aab tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:00.573868 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c04f4867-db76-4f16-a45b-9e5926704aab tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:00.574773 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c04f4867-db76-4f16-a45b-9e5926704aab tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:00.575209 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c04f4867-db76-4f16-a45b-9e5926704aab tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:00.649535 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c04f4867-db76-4f16-a45b-9e5926704aab tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:00.658637 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c04f4867-db76-4f16-a45b-9e5926704aab tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1192 microversion: 2.1 time: 0.116657 Sep 15 07:42:00.660051 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 192/401] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:00 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1192 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:00.819944 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-f14e0125-a448-4e00-82b1-12202b6d51c7 req-281750c6-f0b5-4f69-93d9-254c4337fcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c6ee4c-f348-424e-9fa6-ca2ee2f67967", "name": "network-vif-deleted", "tag": "3b7d0375-a226-4e4b-a78f-fde982eb4c97"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:00.829994 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f14e0125-a448-4e00-82b1-12202b6d51c7 req-281750c6-f0b5-4f69-93d9-254c4337fcbe service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:00.830548 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f14e0125-a448-4e00-82b1-12202b6d51c7 req-281750c6-f0b5-4f69-93d9-254c4337fcbe service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:00.831029 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f14e0125-a448-4e00-82b1-12202b6d51c7 req-281750c6-f0b5-4f69-93d9-254c4337fcbe service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:00.846648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-f14e0125-a448-4e00-82b1-12202b6d51c7 req-281750c6-f0b5-4f69-93d9-254c4337fcbe service nova] Creating event network-vif-deleted:3b7d0375-a226-4e4b-a78f-fde982eb4c97 for instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 on hv-cinder-82414 Sep 15 07:42:00.852178 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-f14e0125-a448-4e00-82b1-12202b6d51c7 req-281750c6-f0b5-4f69-93d9-254c4337fcbe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036011 Sep 15 07:42:00.852783 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 210/402] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:00.926420 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8b808a12-ac4b-43fa-9e54-61341209a35f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:00.927346 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8b808a12-ac4b-43fa-9e54-61341209a35f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:00.934078 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b808a12-ac4b-43fa-9e54-61341209a35f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:00.934563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b808a12-ac4b-43fa-9e54-61341209a35f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:00.934999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b808a12-ac4b-43fa-9e54-61341209a35f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:00.935699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b808a12-ac4b-43fa-9e54-61341209a35f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:00.936146 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b808a12-ac4b-43fa-9e54-61341209a35f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:00.936560 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b808a12-ac4b-43fa-9e54-61341209a35f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:01.015590 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8b808a12-ac4b-43fa-9e54-61341209a35f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:01.026904 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8b808a12-ac4b-43fa-9e54-61341209a35f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1614 microversion: 2.1 time: 0.105257 Sep 15 07:42:01.028204 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 193/403] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:00 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:01.104334 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:01.104969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:01.111723 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:01.112204 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:01.113724 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:01.114361 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:01.114823 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:01.117064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:01.494778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bd672977-3c68-49c6-9f47-3cc95c17949a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:01.496616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bd672977-3c68-49c6-9f47-3cc95c17949a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:01.497359 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:01.513825 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:01.516708 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:01.518232 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d0c75803-3ee4-434c-a191-e2fa9b760c95 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.419349 Sep 15 07:42:01.523544 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 211/404] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:42:01 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:42:01.528303 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd672977-3c68-49c6-9f47-3cc95c17949a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:01.528799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd672977-3c68-49c6-9f47-3cc95c17949a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:01.529234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd672977-3c68-49c6-9f47-3cc95c17949a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:01.529963 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd672977-3c68-49c6-9f47-3cc95c17949a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:01.530417 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd672977-3c68-49c6-9f47-3cc95c17949a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:01.530834 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd672977-3c68-49c6-9f47-3cc95c17949a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:01.682790 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1b21fbde-c8a9-4895-bf56-939dac3c7c3b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:01.683390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1b21fbde-c8a9-4895-bf56-939dac3c7c3b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:01.694633 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1b21fbde-c8a9-4895-bf56-939dac3c7c3b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:01.697690 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1b21fbde-c8a9-4895-bf56-939dac3c7c3b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:01.697690 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1b21fbde-c8a9-4895-bf56-939dac3c7c3b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:01.698699 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1b21fbde-c8a9-4895-bf56-939dac3c7c3b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:01.701289 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1b21fbde-c8a9-4895-bf56-939dac3c7c3b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:01.702078 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1b21fbde-c8a9-4895-bf56-939dac3c7c3b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:02.090137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1b21fbde-c8a9-4895-bf56-939dac3c7c3b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:02.099513 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1b21fbde-c8a9-4895-bf56-939dac3c7c3b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1210 microversion: 2.1 time: 0.420817 Sep 15 07:42:02.117348 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 212/405] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:01 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1210 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:02.120538 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bd672977-3c68-49c6-9f47-3cc95c17949a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:02.121824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:02.122451 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:02.136826 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bd672977-3c68-49c6-9f47-3cc95c17949a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.640944 Sep 15 07:42:02.136826 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 194/406] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:01 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:02.137425 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:02.141002 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:02.141658 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:02.142763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:02.143381 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:02.143823 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:02.185144 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:02.185998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:02.186600 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:02.187225 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lazy-loading 'fault' on Instance uuid 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:42:02.236306 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:02.260426 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-924f9270-128a-4bb2-9468-571315b33d3f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1331 microversion: 2.1 time: 0.139579 Sep 15 07:42:02.262081 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 213/407] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:02 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1331 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:02.558839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:02.560039 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:02.569745 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:02.570829 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:02.570829 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:02.571436 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:02.572062 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:02.572661 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:02.792615 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:02.808161 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:02.809921 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:02.818813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-79070d98-6df7-4ba9-9bf9-2975d084a091 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1808 microversion: 2.20 time: 0.270011 Sep 15 07:42:02.820543 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 195/408] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:42:02 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:42:03.126137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ac416fcf-a435-4717-95e8-17cd1d0231c2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:03.128074 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ac416fcf-a435-4717-95e8-17cd1d0231c2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:03.133451 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac416fcf-a435-4717-95e8-17cd1d0231c2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.133966 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac416fcf-a435-4717-95e8-17cd1d0231c2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.134406 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac416fcf-a435-4717-95e8-17cd1d0231c2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.135098 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac416fcf-a435-4717-95e8-17cd1d0231c2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.135552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac416fcf-a435-4717-95e8-17cd1d0231c2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.135976 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac416fcf-a435-4717-95e8-17cd1d0231c2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.158909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-dbd2ae4a-e28e-429c-b847-5269ab876552 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:03.159527 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-dbd2ae4a-e28e-429c-b847-5269ab876552 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:03.163154 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:03.168101 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dbd2ae4a-e28e-429c-b847-5269ab876552 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.168737 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dbd2ae4a-e28e-429c-b847-5269ab876552 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.169238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dbd2ae4a-e28e-429c-b847-5269ab876552 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.169978 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dbd2ae4a-e28e-429c-b847-5269ab876552 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.170554 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dbd2ae4a-e28e-429c-b847-5269ab876552 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.170988 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dbd2ae4a-e28e-429c-b847-5269ab876552 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.333508 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ac416fcf-a435-4717-95e8-17cd1d0231c2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:03.341456 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ac416fcf-a435-4717-95e8-17cd1d0231c2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1278 microversion: 2.1 time: 0.219248 Sep 15 07:42:03.348166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 214/409] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:03 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:03.348166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:03.348365 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:03.355504 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.355996 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.356433 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.357131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.357615 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.358061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.358799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-dbd2ae4a-e28e-429c-b847-5269ab876552 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:03.368217 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-dbd2ae4a-e28e-429c-b847-5269ab876552 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1502 microversion: 2.1 time: 0.213162 Sep 15 07:42:03.368817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 196/410] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:03 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:03.391094 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.391294 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c83912eb-2b5f-4e39-9fc4-809e2eed1413"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:03.391729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.392240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.392772 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lazy-loading 'fault' on Instance uuid 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:42:03.393554 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:03.399829 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.400312 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.400746 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.401433 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.401908 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.402411 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.427677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] HTTP exception thrown: Cannot 'attach_volume' instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab while it is in vm_state rescued Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Request method failure captured: Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: POST /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab/os-volume_attachments HTTP/1.1 Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 74 Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItbY2L3ItdqVaB73YjwArZPr23BmX6ENHNLZJT2WdCDXyeVG5CK5pKWhEyleF5-RV2_raaWI0zXKOH-9Z9AH41lx9iUPkkpesBFRI5O9kzzv1YOcB8Wq1WkZItvtzmzZi5ZqhWF1QiKcU657CscGnDcQ5M8Dmr2TKDeM6OBUI71wxrM Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: cdc69db806d24d1f8eb18aadaaafabcb Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:42:03.429384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdc69db806d24d1f8eb18aadaaafabcb"}]}] Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: cdc69db806d24d1f8eb18aadaaafabcb Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-ServerRescueNegativeTestJSON-192071295-project Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 21de3a85b2df4af2833a24ab02f477c8 Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-ServerRescueNegativeTestJSON-192071295-project Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {"volumeAttachment": {"volumeId": "c83912eb-2b5f-4e39-9fc4-809e2eed1413"}} Sep 15 07:42:03.431044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Cannot 'attach_volume' instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab while it is in vm_state rescued Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'server_id': '48afb5a2-e7d3-44a4-8882-d81cfd5418ab', 'body': {'volumeAttachment': {'volumeId': 'c83912eb-2b5f-4e39-9fc4-809e2eed1413'}}} Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:42:03.432038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab while it is in vm_state rescued Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:42:03.433435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:42:03.434831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:42:03.434831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:42:03.434831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab while it is in vm_state rescued Sep 15 07:42:03.434831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:42:03.434831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Returning 409 to user: Cannot 'attach_volume' instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab while it is in vm_state rescued {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:42:03.434831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f1abf9f8-2132-4b61-82fb-c80fa078a99d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "POST /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043631 Sep 15 07:42:03.435304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 197/411] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:42:03 2022] POST /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 15 07:42:03.440223 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ed62fea7-8abb-4d0b-9df4-0ff502846068 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:03.441153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ed62fea7-8abb-4d0b-9df4-0ff502846068 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:03.449773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:03.452393 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed62fea7-8abb-4d0b-9df4-0ff502846068 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.452393 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed62fea7-8abb-4d0b-9df4-0ff502846068 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.452663 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed62fea7-8abb-4d0b-9df4-0ff502846068 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.453381 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed62fea7-8abb-4d0b-9df4-0ff502846068 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.453858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed62fea7-8abb-4d0b-9df4-0ff502846068 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.454285 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed62fea7-8abb-4d0b-9df4-0ff502846068 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.456501 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0ec7ae45-75fc-4a14-ad62-276d5e88ea0c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 200 len: 1331 microversion: 2.1 time: 0.113336 Sep 15 07:42:03.457205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 215/412] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:03 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:03.709828 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ed62fea7-8abb-4d0b-9df4-0ff502846068 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "POST /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab/action" status: 202 len: 0 microversion: 2.1 time: 0.272964 Sep 15 07:42:03.713396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 198/413] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:42:03 2022] POST /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:42:03.718670 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9b3b5041-4378-478a-aa60-b546bf1db822 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:03.719695 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9b3b5041-4378-478a-aa60-b546bf1db822 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:03.726617 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b3b5041-4378-478a-aa60-b546bf1db822 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.727335 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b3b5041-4378-478a-aa60-b546bf1db822 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.728004 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b3b5041-4378-478a-aa60-b546bf1db822 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.728934 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b3b5041-4378-478a-aa60-b546bf1db822 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.729672 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b3b5041-4378-478a-aa60-b546bf1db822 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.730306 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b3b5041-4378-478a-aa60-b546bf1db822 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.735073 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:03.851549 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:03.853085 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:03.860156 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.860649 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.861085 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.861810 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:03.862267 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:03.862684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:03.902059 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9b3b5041-4378-478a-aa60-b546bf1db822 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:03.911560 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9b3b5041-4378-478a-aa60-b546bf1db822 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1510 microversion: 2.1 time: 0.196702 Sep 15 07:42:03.912765 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 216/414] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:03 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:04.122056 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:04.131627 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:04.133200 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:04.134489 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8f69281a-6a62-4660-8f13-792ac30634ae tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1795 microversion: 2.20 time: 0.291067 Sep 15 07:42:04.135127 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 199/415] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:42:03 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1795 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:42:04.366065 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b31c1795-26a9-46d5-889e-b2f98f629269 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:04.366680 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b31c1795-26a9-46d5-889e-b2f98f629269 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:04.373016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b31c1795-26a9-46d5-889e-b2f98f629269 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:04.373495 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b31c1795-26a9-46d5-889e-b2f98f629269 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:04.373961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b31c1795-26a9-46d5-889e-b2f98f629269 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:04.374652 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b31c1795-26a9-46d5-889e-b2f98f629269 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:04.375107 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b31c1795-26a9-46d5-889e-b2f98f629269 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:04.375532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b31c1795-26a9-46d5-889e-b2f98f629269 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:04.474105 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-cbb810e3-6187-4d91-8315-6fe5431d8880 req-65e0d7f3-8eaa-41f8-98ce-b69e3b0d9c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfb1a22-faac-4d66-874d-e7866a02a054", "tag": "64d3dfe8-cb43-42b9-b820-a5af2429b050"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:04.485634 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-cbb810e3-6187-4d91-8315-6fe5431d8880 req-65e0d7f3-8eaa-41f8-98ce-b69e3b0d9c5c service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:04.486407 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-cbb810e3-6187-4d91-8315-6fe5431d8880 req-65e0d7f3-8eaa-41f8-98ce-b69e3b0d9c5c service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:04.488279 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-cbb810e3-6187-4d91-8315-6fe5431d8880 req-65e0d7f3-8eaa-41f8-98ce-b69e3b0d9c5c service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:04.494708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:04.513314 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-cbb810e3-6187-4d91-8315-6fe5431d8880 req-65e0d7f3-8eaa-41f8-98ce-b69e3b0d9c5c service nova] Creating event network-changed:64d3dfe8-cb43-42b9-b820-a5af2429b050 for instance 7cfb1a22-faac-4d66-874d-e7866a02a054 on hv-cinder-82414 Sep 15 07:42:04.519889 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-cbb810e3-6187-4d91-8315-6fe5431d8880 req-65e0d7f3-8eaa-41f8-98ce-b69e3b0d9c5c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050753 Sep 15 07:42:04.521086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 200/416] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:04.526471 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:04.527138 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:04.534011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:04.534503 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:04.535011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:04.536067 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:04.536675 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:04.538180 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:04.554977 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 HTTP/1.1 Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:42:04.557478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:42:04.559022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '95c6ee4c-f348-424e-9fa6-ca2ee2f67967'} Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:42:04.565013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:42:04.566582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:42:04.568062 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:42:04.568062 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9c1631a9-d6f7-4024-af6b-fb6d7f1c89da tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 404 len: 111 microversion: 2.1 time: 0.036428 Sep 15 07:42:04.568062 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 201/417] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:04 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:42:04.568546 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2557ae5a-b27c-4ea0-a59d-ca787c6ff430 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '.version_select at 0x7ff36cb87e50>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:04.591343 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b31c1795-26a9-46d5-889e-b2f98f629269 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:04.600983 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b31c1795-26a9-46d5-889e-b2f98f629269 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.239245 Sep 15 07:42:04.601858 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 217/418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:04 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:04.662823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2557ae5a-b27c-4ea0-a59d-ca787c6ff430 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-232708889" status: 202 len: 0 microversion: 2.1 time: 0.098636 Sep 15 07:42:04.663403 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 202/419] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Sep 15 07:42:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-232708889 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:42:04.935636 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1d4cbade-3026-4399-bd3d-515bac1bc288 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:04.936227 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1d4cbade-3026-4399-bd3d-515bac1bc288 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:04.942961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1d4cbade-3026-4399-bd3d-515bac1bc288 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:04.943645 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1d4cbade-3026-4399-bd3d-515bac1bc288 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:04.944079 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1d4cbade-3026-4399-bd3d-515bac1bc288 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:04.944769 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1d4cbade-3026-4399-bd3d-515bac1bc288 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:04.945378 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1d4cbade-3026-4399-bd3d-515bac1bc288 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:04.945822 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1d4cbade-3026-4399-bd3d-515bac1bc288 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:05.001485 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e2b0bf81-f445-466a-aab0-a0ea993c7b3b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:05.002006 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e2b0bf81-f445-466a-aab0-a0ea993c7b3b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:05.009776 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e2b0bf81-f445-466a-aab0-a0ea993c7b3b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:05.010347 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e2b0bf81-f445-466a-aab0-a0ea993c7b3b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:05.010783 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e2b0bf81-f445-466a-aab0-a0ea993c7b3b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:05.011470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e2b0bf81-f445-466a-aab0-a0ea993c7b3b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:05.011920 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e2b0bf81-f445-466a-aab0-a0ea993c7b3b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:05.012336 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e2b0bf81-f445-466a-aab0-a0ea993c7b3b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:05.147679 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-e2b0bf81-f445-466a-aab0-a0ea993c7b3b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lazy-loading 'services' on Instance uuid 417dfb32-7368-4c35-8631-f0ca8b7e2680 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:42:05.173635 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1d4cbade-3026-4399-bd3d-515bac1bc288 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:05.182703 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1d4cbade-3026-4399-bd3d-515bac1bc288 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1510 microversion: 2.1 time: 0.250854 Sep 15 07:42:05.183367 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 218/420] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:04 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:05.414697 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e2b0bf81-f445-466a-aab0-a0ea993c7b3b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "DELETE /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680/os-volume_attachments/ff038343-2856-4780-81d6-c65234f87d6e" status: 202 len: 0 microversion: 2.1 time: 0.416915 Sep 15 07:42:05.415202 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 203/421] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:42:04 2022] DELETE /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680/os-volume_attachments/ff038343-2856-4780-81d6-c65234f87d6e => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:42:05.584269 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1f6845f5-b33c-4c05-b9fc-90f82cefaa53 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:05.587652 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1f6845f5-b33c-4c05-b9fc-90f82cefaa53 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:05.591179 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1f6845f5-b33c-4c05-b9fc-90f82cefaa53 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:05.591667 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1f6845f5-b33c-4c05-b9fc-90f82cefaa53 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:05.592107 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1f6845f5-b33c-4c05-b9fc-90f82cefaa53 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:05.592804 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1f6845f5-b33c-4c05-b9fc-90f82cefaa53 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:05.593261 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1f6845f5-b33c-4c05-b9fc-90f82cefaa53 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:05.593718 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1f6845f5-b33c-4c05-b9fc-90f82cefaa53 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:05.625313 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7f714cb3-827d-406e-9b36-8eb66421c936 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:05.626038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7f714cb3-827d-406e-9b36-8eb66421c936 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:05.632568 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f714cb3-827d-406e-9b36-8eb66421c936 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:05.633044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f714cb3-827d-406e-9b36-8eb66421c936 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:05.633496 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f714cb3-827d-406e-9b36-8eb66421c936 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:05.634205 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f714cb3-827d-406e-9b36-8eb66421c936 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:05.634652 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f714cb3-827d-406e-9b36-8eb66421c936 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:05.635070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f714cb3-827d-406e-9b36-8eb66421c936 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:05.724737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-1f6845f5-b33c-4c05-b9fc-90f82cefaa53 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lazy-loading 'services' on Instance uuid 37cd67df-dd0e-4658-9b80-3c29efd65897 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:42:05.780233 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7f714cb3-827d-406e-9b36-8eb66421c936 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:05.788999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7f714cb3-827d-406e-9b36-8eb66421c936 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.168479 Sep 15 07:42:05.789566 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 204/422] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:05 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:05.993014 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1f6845f5-b33c-4c05-b9fc-90f82cefaa53 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments/acc6d41d-3822-431f-bff8-c8b34f88bfc4" status: 202 len: 0 microversion: 2.1 time: 0.412609 Sep 15 07:42:05.993733 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 219/423] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:42:05 2022] DELETE /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments/acc6d41d-3822-431f-bff8-c8b34f88bfc4 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:42:06.002277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-57a02852-378a-47d7-b3ee-c4b98bdd0e7b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:06.005120 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-57a02852-378a-47d7-b3ee-c4b98bdd0e7b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:06.011202 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57a02852-378a-47d7-b3ee-c4b98bdd0e7b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:06.011691 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57a02852-378a-47d7-b3ee-c4b98bdd0e7b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:06.012125 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57a02852-378a-47d7-b3ee-c4b98bdd0e7b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:06.012819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57a02852-378a-47d7-b3ee-c4b98bdd0e7b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:06.013266 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57a02852-378a-47d7-b3ee-c4b98bdd0e7b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:06.013709 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57a02852-378a-47d7-b3ee-c4b98bdd0e7b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:06.046676 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-57a02852-378a-47d7-b3ee-c4b98bdd0e7b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048257 Sep 15 07:42:06.047164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 205/424] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:42:05 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:06.206361 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1bcdfda5-78cd-4250-b332-23166933c4e0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:06.207685 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1bcdfda5-78cd-4250-b332-23166933c4e0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:06.214019 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bcdfda5-78cd-4250-b332-23166933c4e0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:06.214502 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bcdfda5-78cd-4250-b332-23166933c4e0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:06.214944 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bcdfda5-78cd-4250-b332-23166933c4e0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:06.215638 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bcdfda5-78cd-4250-b332-23166933c4e0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:06.216101 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bcdfda5-78cd-4250-b332-23166933c4e0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:06.216527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bcdfda5-78cd-4250-b332-23166933c4e0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:06.347186 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1bcdfda5-78cd-4250-b332-23166933c4e0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:06.356048 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1bcdfda5-78cd-4250-b332-23166933c4e0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1510 microversion: 2.1 time: 0.154036 Sep 15 07:42:06.356609 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 220/425] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:06 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:06.811495 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-28419627-d0b9-4d0c-998b-c5565cabe95d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:06.812123 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-28419627-d0b9-4d0c-998b-c5565cabe95d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:06.819222 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28419627-d0b9-4d0c-998b-c5565cabe95d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:06.819706 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28419627-d0b9-4d0c-998b-c5565cabe95d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:06.820140 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28419627-d0b9-4d0c-998b-c5565cabe95d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:06.820825 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28419627-d0b9-4d0c-998b-c5565cabe95d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:06.821281 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28419627-d0b9-4d0c-998b-c5565cabe95d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:06.821763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28419627-d0b9-4d0c-998b-c5565cabe95d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:06.950243 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-28419627-d0b9-4d0c-998b-c5565cabe95d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:06.958667 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-28419627-d0b9-4d0c-998b-c5565cabe95d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.150966 Sep 15 07:42:06.959228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 206/426] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:06 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:07.058909 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1a70c17f-df1e-4767-9852-a1d946bdfecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:07.061135 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1a70c17f-df1e-4767-9852-a1d946bdfecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:07.068493 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a70c17f-df1e-4767-9852-a1d946bdfecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:07.068975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a70c17f-df1e-4767-9852-a1d946bdfecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:07.069412 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a70c17f-df1e-4767-9852-a1d946bdfecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:07.070129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a70c17f-df1e-4767-9852-a1d946bdfecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:07.070586 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a70c17f-df1e-4767-9852-a1d946bdfecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:07.071008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a70c17f-df1e-4767-9852-a1d946bdfecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:07.103693 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1a70c17f-df1e-4767-9852-a1d946bdfecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048677 Sep 15 07:42:07.104245 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 221/427] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:42:07 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:07.380908 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ef0720e7-f190-47cc-b08a-d527c3dd9ea7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:07.381521 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ef0720e7-f190-47cc-b08a-d527c3dd9ea7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:07.387471 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef0720e7-f190-47cc-b08a-d527c3dd9ea7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:07.387963 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef0720e7-f190-47cc-b08a-d527c3dd9ea7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:07.388408 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef0720e7-f190-47cc-b08a-d527c3dd9ea7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:07.389113 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef0720e7-f190-47cc-b08a-d527c3dd9ea7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:07.389646 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef0720e7-f190-47cc-b08a-d527c3dd9ea7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:07.390025 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ef0720e7-f190-47cc-b08a-d527c3dd9ea7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:07.524076 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ef0720e7-f190-47cc-b08a-d527c3dd9ea7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:07.532650 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ef0720e7-f190-47cc-b08a-d527c3dd9ea7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1516 microversion: 2.1 time: 0.156126 Sep 15 07:42:07.533232 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 207/428] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:07 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:07.982197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e7ec816f-3dc6-4c85-b7da-0b6b5f5e39eb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:07.982801 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e7ec816f-3dc6-4c85-b7da-0b6b5f5e39eb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:07.988935 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e7ec816f-3dc6-4c85-b7da-0b6b5f5e39eb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:07.989415 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e7ec816f-3dc6-4c85-b7da-0b6b5f5e39eb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:07.989882 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e7ec816f-3dc6-4c85-b7da-0b6b5f5e39eb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:07.990592 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e7ec816f-3dc6-4c85-b7da-0b6b5f5e39eb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:07.991038 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e7ec816f-3dc6-4c85-b7da-0b6b5f5e39eb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:07.991455 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e7ec816f-3dc6-4c85-b7da-0b6b5f5e39eb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:08.118739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b003b92f-3436-4104-a717-1e1287cf3223 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:08.121813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b003b92f-3436-4104-a717-1e1287cf3223 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:08.141667 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b003b92f-3436-4104-a717-1e1287cf3223 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:08.142166 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b003b92f-3436-4104-a717-1e1287cf3223 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:08.142597 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b003b92f-3436-4104-a717-1e1287cf3223 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:08.142967 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e7ec816f-3dc6-4c85-b7da-0b6b5f5e39eb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:08.143435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b003b92f-3436-4104-a717-1e1287cf3223 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:08.143736 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b003b92f-3436-4104-a717-1e1287cf3223 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:08.144179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b003b92f-3436-4104-a717-1e1287cf3223 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:08.153362 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e7ec816f-3dc6-4c85-b7da-0b6b5f5e39eb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.174792 Sep 15 07:42:08.153912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 222/429] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:07 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:08.177374 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b003b92f-3436-4104-a717-1e1287cf3223 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065246 Sep 15 07:42:08.181375 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 208/430] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:42:08 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:42:08.679425 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c6e0cf43-1ac7-4e2a-bff9-f897d7f22737 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:08.679932 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c6e0cf43-1ac7-4e2a-bff9-f897d7f22737 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:08.685964 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6e0cf43-1ac7-4e2a-bff9-f897d7f22737 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:08.686447 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6e0cf43-1ac7-4e2a-bff9-f897d7f22737 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:08.686920 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6e0cf43-1ac7-4e2a-bff9-f897d7f22737 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:08.687609 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6e0cf43-1ac7-4e2a-bff9-f897d7f22737 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:08.688061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6e0cf43-1ac7-4e2a-bff9-f897d7f22737 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:08.688485 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6e0cf43-1ac7-4e2a-bff9-f897d7f22737 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:08.713931 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c6e0cf43-1ac7-4e2a-bff9-f897d7f22737 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:42:08.947207 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:09.015437 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c6e0cf43-1ac7-4e2a-bff9-f897d7f22737 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "DELETE /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 204 len: 0 microversion: 2.1 time: 0.340213 Sep 15 07:42:09.016214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 223/431] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:42:08 2022] DELETE /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:42:09.024895 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-691253ca-6b3a-45ed-b0c8-e96373db5f93 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:09.025508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-691253ca-6b3a-45ed-b0c8-e96373db5f93 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:09.031588 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-691253ca-6b3a-45ed-b0c8-e96373db5f93 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:09.032073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-691253ca-6b3a-45ed-b0c8-e96373db5f93 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:09.032540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-691253ca-6b3a-45ed-b0c8-e96373db5f93 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:09.033234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-691253ca-6b3a-45ed-b0c8-e96373db5f93 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:09.033716 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-691253ca-6b3a-45ed-b0c8-e96373db5f93 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:09.034141 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-691253ca-6b3a-45ed-b0c8-e96373db5f93 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:09.168551 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-691253ca-6b3a-45ed-b0c8-e96373db5f93 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:09.176937 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-691253ca-6b3a-45ed-b0c8-e96373db5f93 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1515 microversion: 2.1 time: 0.155464 Sep 15 07:42:09.177922 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 209/432] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:09 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:09.191878 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5ae24bda-7f10-41e8-af6b-c103622a58d4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:09.193550 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5ae24bda-7f10-41e8-af6b-c103622a58d4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:09.198284 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bbe994f4-cd14-42aa-86e0-80bf1dcf0013 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:09.200556 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bbe994f4-cd14-42aa-86e0-80bf1dcf0013 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:09.201152 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5ae24bda-7f10-41e8-af6b-c103622a58d4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:09.202038 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5ae24bda-7f10-41e8-af6b-c103622a58d4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:09.202632 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5ae24bda-7f10-41e8-af6b-c103622a58d4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:09.203545 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5ae24bda-7f10-41e8-af6b-c103622a58d4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:09.204253 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5ae24bda-7f10-41e8-af6b-c103622a58d4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:09.204835 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5ae24bda-7f10-41e8-af6b-c103622a58d4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:09.207973 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe994f4-cd14-42aa-86e0-80bf1dcf0013 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:09.208524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe994f4-cd14-42aa-86e0-80bf1dcf0013 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:09.209029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe994f4-cd14-42aa-86e0-80bf1dcf0013 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:09.209831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe994f4-cd14-42aa-86e0-80bf1dcf0013 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:09.210365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe994f4-cd14-42aa-86e0-80bf1dcf0013 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:09.210857 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bbe994f4-cd14-42aa-86e0-80bf1dcf0013 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:09.243554 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bbe994f4-cd14-42aa-86e0-80bf1dcf0013 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052751 Sep 15 07:42:09.251682 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 210/433] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:42:09 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 07:42:09.251682 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e794113f-5a59-4728-ac63-a6b558955d05 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Action: 'create', calling method: .version_select at 0x7ff36cacf700>, body: {"keypair": {"name": "tempest-keypair-1939006037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTKYMbZYHIVWO2gW65NijVbfyjfXJkSu9pM44+aluPY+bTBYBgtW9nSwgDZgMgpucYlb5Z74uF1EowzSFeDQ0IISufNiNQ7Tabi4zbO0CG7fif5s1qnIP/qu9rd1MVhDA=="}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:09.266598 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-e794113f-5a59-4728-ac63-a6b558955d05 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Getting quotas for project cdc69db806d24d1f8eb18aadaaafabcb. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:42:09.271832 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-e794113f-5a59-4728-ac63-a6b558955d05 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Getting quotas for user 21de3a85b2df4af2833a24ab02f477c8 and project cdc69db806d24d1f8eb18aadaaafabcb. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:42:09.342837 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e794113f-5a59-4728-ac63-a6b558955d05 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097662 Sep 15 07:42:09.343605 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 211/434] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 15 07:42:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:09.348568 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2a6fb6be-8eca-4f63-9628-f4aae826319a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:09.349860 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2a6fb6be-8eca-4f63-9628-f4aae826319a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:09.355993 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2a6fb6be-8eca-4f63-9628-f4aae826319a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:09.356434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2a6fb6be-8eca-4f63-9628-f4aae826319a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:09.356874 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2a6fb6be-8eca-4f63-9628-f4aae826319a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:09.357572 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2a6fb6be-8eca-4f63-9628-f4aae826319a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:09.358047 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2a6fb6be-8eca-4f63-9628-f4aae826319a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:09.358302 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5ae24bda-7f10-41e8-af6b-c103622a58d4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:09.358616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2a6fb6be-8eca-4f63-9628-f4aae826319a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:09.369674 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5ae24bda-7f10-41e8-af6b-c103622a58d4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.182838 Sep 15 07:42:09.369939 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 224/435] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:09 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:09.393112 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2a6fb6be-8eca-4f63-9628-f4aae826319a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Going to try to terminate instance {{(pid=132673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:42:09.705365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2a6fb6be-8eca-4f63-9628-f4aae826319a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 204 len: 0 microversion: 2.1 time: 0.360674 Sep 15 07:42:09.705995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 212/436] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:42:09 2022] DELETE /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:42:09.714985 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3f9946da-d3b1-4773-bb75-2f726c23622b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:09.715626 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3f9946da-d3b1-4773-bb75-2f726c23622b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:09.721696 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f9946da-d3b1-4773-bb75-2f726c23622b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:09.722185 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f9946da-d3b1-4773-bb75-2f726c23622b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:09.722628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f9946da-d3b1-4773-bb75-2f726c23622b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:09.724376 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f9946da-d3b1-4773-bb75-2f726c23622b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:09.724843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f9946da-d3b1-4773-bb75-2f726c23622b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:09.725274 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3f9946da-d3b1-4773-bb75-2f726c23622b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:09.856369 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3f9946da-d3b1-4773-bb75-2f726c23622b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:09.864231 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3f9946da-d3b1-4773-bb75-2f726c23622b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1679 microversion: 2.1 time: 0.152995 Sep 15 07:42:09.865026 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 225/437] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:09 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:09.992808 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-315963296", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1265932845", "security_groups": [{"name": "tempest-secgroup-smoke-775038891"}], "networks": [{"uuid": "85a7f1ba-3d89-421a-8e93-c34cc3e5ffc3"}], "block_device_mapping_v2": [{"uuid": "b25ffdf2-e9bf-4cce-b783-de884e1daa06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:10.110724 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] validate_networks() for [('85a7f1ba-3d89-421a-8e93-c34cc3e5ffc3', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:42:10.202046 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ba1c8c62-1744-4f97-8411-7ec736184a13 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:10.202588 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ba1c8c62-1744-4f97-8411-7ec736184a13 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:10.208847 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba1c8c62-1744-4f97-8411-7ec736184a13 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:10.209336 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba1c8c62-1744-4f97-8411-7ec736184a13 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:10.209798 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba1c8c62-1744-4f97-8411-7ec736184a13 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:10.210712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba1c8c62-1744-4f97-8411-7ec736184a13 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:10.211180 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba1c8c62-1744-4f97-8411-7ec736184a13 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:10.211598 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba1c8c62-1744-4f97-8411-7ec736184a13 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:10.440331 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ba1c8c62-1744-4f97-8411-7ec736184a13 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:10.447982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ba1c8c62-1744-4f97-8411-7ec736184a13 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1515 microversion: 2.1 time: 0.249785 Sep 15 07:42:10.448541 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 226/438] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:10 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:10.461192 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4d5f3fa6-d61d-43c8-8b10-050a7cf08926 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:10.462132 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-4d5f3fa6-d61d-43c8-8b10-050a7cf08926 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:10.468069 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4d5f3fa6-d61d-43c8-8b10-050a7cf08926 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:10.468617 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4d5f3fa6-d61d-43c8-8b10-050a7cf08926 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:10.469887 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4d5f3fa6-d61d-43c8-8b10-050a7cf08926 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:10.469887 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4d5f3fa6-d61d-43c8-8b10-050a7cf08926 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:10.470289 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4d5f3fa6-d61d-43c8-8b10-050a7cf08926 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:10.470716 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4d5f3fa6-d61d-43c8-8b10-050a7cf08926 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:10.638804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:42:10.639338 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:42:10.639763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:42:10.640175 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:42:10.640717 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:42:10.651812 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:10.652041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:10.652394 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:10.653464 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:10.653958 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:10.654422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:10.665941 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4d5f3fa6-d61d-43c8-8b10-050a7cf08926 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:10.673888 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Getting quotas for project 7e20a6e5fded473c8905bffff7775ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:42:10.674567 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4d5f3fa6-d61d-43c8-8b10-050a7cf08926 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.217552 Sep 15 07:42:10.675371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 227/439] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:10 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:10.678142 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Getting quotas for user 0a1410abac494fd18c859268b528ec0c and project 7e20a6e5fded473c8905bffff7775ed3. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:42:10.742929 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:42:10.745185 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b25ffdf2-e9bf-4cce-b783-de884e1daa06',volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:42:10.888436 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-873a3ac0-f889-4018-a316-38073036d31c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:10.889084 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-873a3ac0-f889-4018-a316-38073036d31c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:10.895034 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-873a3ac0-f889-4018-a316-38073036d31c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:10.896120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-873a3ac0-f889-4018-a316-38073036d31c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:10.896559 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-873a3ac0-f889-4018-a316-38073036d31c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:10.897246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-873a3ac0-f889-4018-a316-38073036d31c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:10.897734 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-873a3ac0-f889-4018-a316-38073036d31c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:10.898187 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-873a3ac0-f889-4018-a316-38073036d31c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:11.043593 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-873a3ac0-f889-4018-a316-38073036d31c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:11.052221 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-873a3ac0-f889-4018-a316-38073036d31c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1679 microversion: 2.1 time: 0.167142 Sep 15 07:42:11.053274 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 228/440] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:10 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:11.177887 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5f7b22f4-72a0-42a7-88f2-cd9f5188e171 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.189350 Sep 15 07:42:11.178545 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 213/441] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:42:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:42:11.190026 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-23dfad9f-f8fb-47a6-bdb7-e8a005970504 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:11.190644 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-23dfad9f-f8fb-47a6-bdb7-e8a005970504 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:11.246832 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-23dfad9f-f8fb-47a6-bdb7-e8a005970504 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:11.255574 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-23dfad9f-f8fb-47a6-bdb7-e8a005970504 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1088 microversion: 2.1 time: 0.069215 Sep 15 07:42:11.256502 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 229/442] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:11 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:11.475894 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-041c3127-0b12-4de4-89dc-92914409ca47 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:11.476932 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-041c3127-0b12-4de4-89dc-92914409ca47 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:11.486785 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-041c3127-0b12-4de4-89dc-92914409ca47 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:11.486785 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-041c3127-0b12-4de4-89dc-92914409ca47 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:11.486785 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-041c3127-0b12-4de4-89dc-92914409ca47 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:11.487139 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-041c3127-0b12-4de4-89dc-92914409ca47 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:11.487590 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-041c3127-0b12-4de4-89dc-92914409ca47 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:11.488010 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-041c3127-0b12-4de4-89dc-92914409ca47 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:11.617734 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-041c3127-0b12-4de4-89dc-92914409ca47 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:11.625781 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-041c3127-0b12-4de4-89dc-92914409ca47 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1515 microversion: 2.1 time: 0.157989 Sep 15 07:42:11.626418 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 214/443] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:11 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:11.689274 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2079865784", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9125b9da-cf0a-438e-a321-05e9db8df553"}], "security_groups": [{"name": "tempest-securitygroup--543704450"}], "key_name": "tempest-keypair-1939006037", "user_data": "}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:11.699146 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0395997c-f752-4311-98f2-31841f302081 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:11.699692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0395997c-f752-4311-98f2-31841f302081 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:11.705686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0395997c-f752-4311-98f2-31841f302081 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:11.706182 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0395997c-f752-4311-98f2-31841f302081 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:11.706621 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0395997c-f752-4311-98f2-31841f302081 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:11.707321 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0395997c-f752-4311-98f2-31841f302081 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:11.708399 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0395997c-f752-4311-98f2-31841f302081 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:11.708864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0395997c-f752-4311-98f2-31841f302081 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:11.845760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.network.neutron [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] validate_networks() for [('9125b9da-cf0a-438e-a321-05e9db8df553', None, None, None, None, None)] {{(pid=132674) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:42:11.933006 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0395997c-f752-4311-98f2-31841f302081 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:11.946882 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0395997c-f752-4311-98f2-31841f302081 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.251481 Sep 15 07:42:11.947468 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 215/444] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:11 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:12.075845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6c1d4a94-2a66-4f33-ac64-1f277a710cc3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:12.076555 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6c1d4a94-2a66-4f33-ac64-1f277a710cc3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:12.082765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c1d4a94-2a66-4f33-ac64-1f277a710cc3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:12.083690 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c1d4a94-2a66-4f33-ac64-1f277a710cc3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:12.084222 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c1d4a94-2a66-4f33-ac64-1f277a710cc3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:12.085010 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c1d4a94-2a66-4f33-ac64-1f277a710cc3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:12.085457 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c1d4a94-2a66-4f33-ac64-1f277a710cc3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:12.085977 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c1d4a94-2a66-4f33-ac64-1f277a710cc3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:12.312246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6c1d4a94-2a66-4f33-ac64-1f277a710cc3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:12.321373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6c1d4a94-2a66-4f33-ac64-1f277a710cc3 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1679 microversion: 2.1 time: 0.249256 Sep 15 07:42:12.323417 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 216/445] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:12 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:12.329275 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e335b4a6-dc53-4d07-8d7f-4918de7270cc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:12.331923 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e335b4a6-dc53-4d07-8d7f-4918de7270cc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:12.337425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e335b4a6-dc53-4d07-8d7f-4918de7270cc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:12.337947 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e335b4a6-dc53-4d07-8d7f-4918de7270cc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:12.338385 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e335b4a6-dc53-4d07-8d7f-4918de7270cc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:12.339073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e335b4a6-dc53-4d07-8d7f-4918de7270cc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:12.339522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e335b4a6-dc53-4d07-8d7f-4918de7270cc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:12.339939 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e335b4a6-dc53-4d07-8d7f-4918de7270cc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:12.413551 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Flavor limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:42:12.414167 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Image limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:42:12.414671 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Flavor pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:42:12.415178 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Image pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:42:12.415687 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:42:12.425017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:12.427628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:12.427628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:12.427628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:12.429988 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:12.430832 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:12.431609 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e335b4a6-dc53-4d07-8d7f-4918de7270cc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:12.439535 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e335b4a6-dc53-4d07-8d7f-4918de7270cc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1138 microversion: 2.1 time: 0.114897 Sep 15 07:42:12.440532 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 217/446] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:12 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1138 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:12.455061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Getting quotas for project cdc69db806d24d1f8eb18aadaaafabcb. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:42:12.462767 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Getting quotas for user 21de3a85b2df4af2833a24ab02f477c8 and project cdc69db806d24d1f8eb18aadaaafabcb. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:42:12.479541 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Going to run 1 instances... {{(pid=132674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:42:12.482183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:42:12.595504 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c5ebf292-74db-40b3-903a-5706765487d5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.911140 Sep 15 07:42:12.596600 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 230/447] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:42:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:42:12.608108 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4a2ca7dd-5156-4728-9be8-9b42082a948a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:12.608792 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4a2ca7dd-5156-4728-9be8-9b42082a948a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:12.654544 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-46e56aef-0c36-4d8b-8222-ecbba6147f4f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:12.654544 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-46e56aef-0c36-4d8b-8222-ecbba6147f4f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:12.660236 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46e56aef-0c36-4d8b-8222-ecbba6147f4f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:12.660850 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46e56aef-0c36-4d8b-8222-ecbba6147f4f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:12.675251 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46e56aef-0c36-4d8b-8222-ecbba6147f4f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:12.678183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46e56aef-0c36-4d8b-8222-ecbba6147f4f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:12.678813 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46e56aef-0c36-4d8b-8222-ecbba6147f4f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:12.681825 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46e56aef-0c36-4d8b-8222-ecbba6147f4f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:13.068406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4a2ca7dd-5156-4728-9be8-9b42082a948a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:13.075737 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4a2ca7dd-5156-4728-9be8-9b42082a948a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1246 microversion: 2.1 time: 0.471328 Sep 15 07:42:13.076543 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 218/448] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:12 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1246 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:13.081869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-f4ed9705-4f2d-4211-bc13-261f8e0bef23 req-892dfa79-34c9-4af0-a97b-52476d1fbe20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dfb32-7368-4c35-8631-f0ca8b7e2680", "name": "network-vif-deleted", "tag": "5f558303-6561-42ea-8bcc-d87ad98fc906"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:13.092274 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-f4ed9705-4f2d-4211-bc13-261f8e0bef23 req-892dfa79-34c9-4af0-a97b-52476d1fbe20 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:13.092925 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-46e56aef-0c36-4d8b-8222-ecbba6147f4f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:13.093179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-f4ed9705-4f2d-4211-bc13-261f8e0bef23 req-892dfa79-34c9-4af0-a97b-52476d1fbe20 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:13.093810 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-f4ed9705-4f2d-4211-bc13-261f8e0bef23 req-892dfa79-34c9-4af0-a97b-52476d1fbe20 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:13.104006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-46e56aef-0c36-4d8b-8222-ecbba6147f4f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1473 microversion: 2.1 time: 0.456559 Sep 15 07:42:13.109069 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-f4ed9705-4f2d-4211-bc13-261f8e0bef23 req-892dfa79-34c9-4af0-a97b-52476d1fbe20 service nova] Creating event network-vif-deleted:5f558303-6561-42ea-8bcc-d87ad98fc906 for instance 417dfb32-7368-4c35-8631-f0ca8b7e2680 on hv-cinder-82414 Sep 15 07:42:13.109214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 231/449] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:12 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1473 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:13.114985 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-f4ed9705-4f2d-4211-bc13-261f8e0bef23 req-892dfa79-34c9-4af0-a97b-52476d1fbe20 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036839 Sep 15 07:42:13.120093 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 219/450] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:13.130068 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-eb821568-4532-4682-bea5-7586b8a9ac1a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:13.130786 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-eb821568-4532-4682-bea5-7586b8a9ac1a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:13.137826 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb821568-4532-4682-bea5-7586b8a9ac1a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:13.145114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb821568-4532-4682-bea5-7586b8a9ac1a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:13.145114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb821568-4532-4682-bea5-7586b8a9ac1a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:13.145114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb821568-4532-4682-bea5-7586b8a9ac1a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:13.145114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb821568-4532-4682-bea5-7586b8a9ac1a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:13.146140 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eb821568-4532-4682-bea5-7586b8a9ac1a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:13.146140 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:13.346879 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9c4c6915-8d4e-4855-b2aa-7c3f99dfb2b9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:13.347583 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-9c4c6915-8d4e-4855-b2aa-7c3f99dfb2b9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:13.354560 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4c6915-8d4e-4855-b2aa-7c3f99dfb2b9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:13.355052 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4c6915-8d4e-4855-b2aa-7c3f99dfb2b9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:13.355492 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4c6915-8d4e-4855-b2aa-7c3f99dfb2b9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:13.358612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-eb821568-4532-4682-bea5-7586b8a9ac1a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:13.362234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4c6915-8d4e-4855-b2aa-7c3f99dfb2b9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:13.362921 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4c6915-8d4e-4855-b2aa-7c3f99dfb2b9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:13.363522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4c6915-8d4e-4855-b2aa-7c3f99dfb2b9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:13.369373 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-eb821568-4532-4682-bea5-7586b8a9ac1a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.246195 Sep 15 07:42:13.370070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 232/451] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:13 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:13.385686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:13.472208 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bc4053c9-93d2-41af-b799-c8a176bc96d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:13.472208 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bc4053c9-93d2-41af-b799-c8a176bc96d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:13.478429 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc4053c9-93d2-41af-b799-c8a176bc96d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:13.479181 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc4053c9-93d2-41af-b799-c8a176bc96d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:13.479844 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc4053c9-93d2-41af-b799-c8a176bc96d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:13.480770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc4053c9-93d2-41af-b799-c8a176bc96d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:13.481601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc4053c9-93d2-41af-b799-c8a176bc96d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:13.482032 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc4053c9-93d2-41af-b799-c8a176bc96d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:13.518205 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-9c4c6915-8d4e-4855-b2aa-7c3f99dfb2b9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:13.527329 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9c4c6915-8d4e-4855-b2aa-7c3f99dfb2b9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1679 microversion: 2.1 time: 0.185185 Sep 15 07:42:13.529567 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 220/452] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:13 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:13.574055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bc4053c9-93d2-41af-b799-c8a176bc96d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:13.585011 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bc4053c9-93d2-41af-b799-c8a176bc96d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1186 microversion: 2.1 time: 0.120381 Sep 15 07:42:13.586752 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 233/453] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:13 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1186 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:13.856358 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-c61e371c-dfe6-42bc-bde1-02c5d3db5f4a req-7cb9d728-6767-494f-9d5d-84907b1a8bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37cd67df-dd0e-4658-9b80-3c29efd65897", "name": "network-vif-deleted", "tag": "56775397-b0d1-4018-9f3c-25e559549950"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:13.867722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c61e371c-dfe6-42bc-bde1-02c5d3db5f4a req-7cb9d728-6767-494f-9d5d-84907b1a8bc5 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:13.868226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c61e371c-dfe6-42bc-bde1-02c5d3db5f4a req-7cb9d728-6767-494f-9d5d-84907b1a8bc5 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:13.868654 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c61e371c-dfe6-42bc-bde1-02c5d3db5f4a req-7cb9d728-6767-494f-9d5d-84907b1a8bc5 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:13.880523 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-c61e371c-dfe6-42bc-bde1-02c5d3db5f4a req-7cb9d728-6767-494f-9d5d-84907b1a8bc5 service nova] Creating event network-vif-deleted:56775397-b0d1-4018-9f3c-25e559549950 for instance 37cd67df-dd0e-4658-9b80-3c29efd65897 on hv-cinder-82414 Sep 15 07:42:13.885567 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-c61e371c-dfe6-42bc-bde1-02c5d3db5f4a req-7cb9d728-6767-494f-9d5d-84907b1a8bc5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033209 Sep 15 07:42:13.886192 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 221/454] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:14.105151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-75b52e5b-77b5-4165-a2ca-49e7e7e006e5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:14.105787 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-75b52e5b-77b5-4165-a2ca-49e7e7e006e5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:14.113881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-75b52e5b-77b5-4165-a2ca-49e7e7e006e5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:14.113881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-75b52e5b-77b5-4165-a2ca-49e7e7e006e5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:14.113881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-75b52e5b-77b5-4165-a2ca-49e7e7e006e5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:14.114382 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-75b52e5b-77b5-4165-a2ca-49e7e7e006e5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:14.114481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-75b52e5b-77b5-4165-a2ca-49e7e7e006e5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:14.114848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-75b52e5b-77b5-4165-a2ca-49e7e7e006e5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:14.138003 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:14.141830 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:14.147490 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:14.148195 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:14.148637 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:14.149371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:14.149853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:14.150282 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:14.180200 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-75b52e5b-77b5-4165-a2ca-49e7e7e006e5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:14.184148 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:14.184636 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:14.185072 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:14.185523 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lazy-loading 'fault' on Instance uuid 417dfb32-7368-4c35-8631-f0ca8b7e2680 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:42:14.189296 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-75b52e5b-77b5-4165-a2ca-49e7e7e006e5 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1250 microversion: 2.1 time: 0.087667 Sep 15 07:42:14.190136 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 234/455] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:14 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1250 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:14.230285 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:14.237969 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-1ebf86ab-e192-419a-aa6e-c8f9e76e07a3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1309 microversion: 2.1 time: 0.104172 Sep 15 07:42:14.238586 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 222/456] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:14 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:14.392908 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-85f22fb0-7afa-4d58-83f7-7e07ca6fcaff tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:14.393542 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-85f22fb0-7afa-4d58-83f7-7e07ca6fcaff tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:14.400691 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85f22fb0-7afa-4d58-83f7-7e07ca6fcaff tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:14.401183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85f22fb0-7afa-4d58-83f7-7e07ca6fcaff tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:14.401654 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85f22fb0-7afa-4d58-83f7-7e07ca6fcaff tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:14.402400 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85f22fb0-7afa-4d58-83f7-7e07ca6fcaff tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:14.402857 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85f22fb0-7afa-4d58-83f7-7e07ca6fcaff tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:14.403287 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85f22fb0-7afa-4d58-83f7-7e07ca6fcaff tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:14.552234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2ddc80ca-292f-4da2-a5a7-80aba4756bc6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:14.552851 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2ddc80ca-292f-4da2-a5a7-80aba4756bc6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:14.559909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ddc80ca-292f-4da2-a5a7-80aba4756bc6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:14.560368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ddc80ca-292f-4da2-a5a7-80aba4756bc6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:14.560836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ddc80ca-292f-4da2-a5a7-80aba4756bc6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:14.561512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ddc80ca-292f-4da2-a5a7-80aba4756bc6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:14.565026 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ddc80ca-292f-4da2-a5a7-80aba4756bc6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:14.568377 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2ddc80ca-292f-4da2-a5a7-80aba4756bc6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:14.697729 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-2ddc80ca-292f-4da2-a5a7-80aba4756bc6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:14.722286 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-85f22fb0-7afa-4d58-83f7-7e07ca6fcaff tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:14.727030 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2ddc80ca-292f-4da2-a5a7-80aba4756bc6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1324 microversion: 2.1 time: 0.176262 Sep 15 07:42:14.728539 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 223/457] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:14 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1324 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:14.735338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-85f22fb0-7afa-4d58-83f7-7e07ca6fcaff tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.337951 Sep 15 07:42:14.738102 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-31125130-e884-422e-841a-026475dea206 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:14.739131 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-31125130-e884-422e-841a-026475dea206 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:14.745886 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31125130-e884-422e-841a-026475dea206 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:14.746647 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31125130-e884-422e-841a-026475dea206 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:14.747438 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31125130-e884-422e-841a-026475dea206 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:14.748344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31125130-e884-422e-841a-026475dea206 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:14.748997 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31125130-e884-422e-841a-026475dea206 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:14.749640 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-31125130-e884-422e-841a-026475dea206 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:14.761630 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 235/458] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:14 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:14.853736 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-31125130-e884-422e-841a-026475dea206 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:14.861965 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-31125130-e884-422e-841a-026475dea206 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1194 microversion: 2.1 time: 0.132170 Sep 15 07:42:14.862538 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 224/459] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:14 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1194 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:15.212657 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-22b5e52d-4e47-4282-867d-8cd035cb64e3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:15.213274 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-22b5e52d-4e47-4282-867d-8cd035cb64e3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:15.220577 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22b5e52d-4e47-4282-867d-8cd035cb64e3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.222991 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22b5e52d-4e47-4282-867d-8cd035cb64e3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.222991 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22b5e52d-4e47-4282-867d-8cd035cb64e3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.222991 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22b5e52d-4e47-4282-867d-8cd035cb64e3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.222991 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22b5e52d-4e47-4282-867d-8cd035cb64e3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.223405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22b5e52d-4e47-4282-867d-8cd035cb64e3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.264424 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:15.265159 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:15.271624 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.272216 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.272728 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.273500 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.274094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.274696 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.307971 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.308460 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.308894 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.309350 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lazy-loading 'fault' on Instance uuid 417dfb32-7368-4c35-8631-f0ca8b7e2680 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:42:15.351030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-22b5e52d-4e47-4282-867d-8cd035cb64e3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:15.358798 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-22b5e52d-4e47-4282-867d-8cd035cb64e3 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1242 microversion: 2.1 time: 0.149813 Sep 15 07:42:15.359374 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 236/460] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:15 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1242 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:15.392980 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:15.402091 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-741aeb9f-1876-4795-a1a0-fe36153616c2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 200 len: 1309 microversion: 2.1 time: 0.141469 Sep 15 07:42:15.406524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 225/461] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:15 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:15.751602 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:15.752734 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:15.759815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.760492 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.761323 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.761932 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.762655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.763174 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.765777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a1b407e0-5272-4d1e-a007-b616fb96cd31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:15.766388 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a1b407e0-5272-4d1e-a007-b616fb96cd31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:15.770900 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:15.774482 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1b407e0-5272-4d1e-a007-b616fb96cd31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.774965 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1b407e0-5272-4d1e-a007-b616fb96cd31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.775403 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1b407e0-5272-4d1e-a007-b616fb96cd31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.776201 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1b407e0-5272-4d1e-a007-b616fb96cd31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.776572 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1b407e0-5272-4d1e-a007-b616fb96cd31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.777161 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1b407e0-5272-4d1e-a007-b616fb96cd31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.807362 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.808382 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.808904 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.809760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lazy-loading 'fault' on Instance uuid 37cd67df-dd0e-4658-9b80-3c29efd65897 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:42:15.887612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:15.895543 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0613cd4e-07f4-4ba5-b800-5bf9cb1eff27 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1329 microversion: 2.1 time: 0.147891 Sep 15 07:42:15.896214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 237/462] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:15 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1329 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:15.900622 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d72d9c99-e8d6-4192-b390-f69b42873684 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:15.901259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d72d9c99-e8d6-4192-b390-f69b42873684 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:15.907458 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d72d9c99-e8d6-4192-b390-f69b42873684 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.908150 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d72d9c99-e8d6-4192-b390-f69b42873684 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.908587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d72d9c99-e8d6-4192-b390-f69b42873684 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.909273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d72d9c99-e8d6-4192-b390-f69b42873684 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:15.910002 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d72d9c99-e8d6-4192-b390-f69b42873684 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:15.910565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d72d9c99-e8d6-4192-b390-f69b42873684 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:15.976459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a1b407e0-5272-4d1e-a007-b616fb96cd31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:15.984604 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a1b407e0-5272-4d1e-a007-b616fb96cd31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.223025 Sep 15 07:42:15.985190 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 226/463] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:15 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:16.119381 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d72d9c99-e8d6-4192-b390-f69b42873684 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:16.127830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d72d9c99-e8d6-4192-b390-f69b42873684 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1271 microversion: 2.1 time: 0.230671 Sep 15 07:42:16.128406 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 238/464] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:15 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:16.385020 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-475b4ced-00b5-4e57-aa68-bff1258fa2fb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:16.390386 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-475b4ced-00b5-4e57-aa68-bff1258fa2fb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:16.397740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475b4ced-00b5-4e57-aa68-bff1258fa2fb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:16.398232 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475b4ced-00b5-4e57-aa68-bff1258fa2fb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:16.398670 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475b4ced-00b5-4e57-aa68-bff1258fa2fb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:16.401783 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475b4ced-00b5-4e57-aa68-bff1258fa2fb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:16.402474 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475b4ced-00b5-4e57-aa68-bff1258fa2fb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:16.403092 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475b4ced-00b5-4e57-aa68-bff1258fa2fb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:16.428657 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:16.429626 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: 417dfb32-7368-4c35-8631-f0ca8b7e2680] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:16.437535 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:16.439067 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:16.439743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:16.442108 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:16.443468 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:16.444331 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:16.465803 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] HTTP exception thrown: Instance 417dfb32-7368-4c35-8631-f0ca8b7e2680 could not be found. Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Request method failure captured: Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 HTTP/1.1 Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItcDZLwGA2NfZ3QB6YdfdruhKepNTCgFAsq-mtCtT_4HVNQ54daN30fASP0NBFlqC4fq-QBoNX2gMk7SQgrV0TeD9bqUpweuODCjey1Me8U6IXWJlKK7ZIvcoqsWyRTk0pMl-BLIDKfiUCmoc17JCL7DForijQNfT1YP28m1z9SnbDM Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: 66cb9c7c7eb24e30bf89b3680c713472 Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-VolumesSnapshotTestJSON-172324038 Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:42:16.468758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66cb9c7c7eb24e30bf89b3680c713472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66cb9c7c7eb24e30bf89b3680c713472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66cb9c7c7eb24e30bf89b3680c713472"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66cb9c7c7eb24e30bf89b3680c713472"}]}] Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-VolumesSnapshotTestJSON-172324038 Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: 66cb9c7c7eb24e30bf89b3680c713472 Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-172324038 Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-VolumesSnapshotTestJSON-172324038-project Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: ae7e3a9a28134a28a3f8f30d4b0fcb8c Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-VolumesSnapshotTestJSON-172324038-project Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 417dfb32-7368-4c35-8631-f0ca8b7e2680 could not be found. Sep 15 07:42:16.470266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '417dfb32-7368-4c35-8631-f0ca8b7e2680'} Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417dfb32-7368-4c35-8631-f0ca8b7e2680 could not be found. Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:42:16.471018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417dfb32-7368-4c35-8631-f0ca8b7e2680 could not be found. Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417dfb32-7368-4c35-8631-f0ca8b7e2680 could not be found. Sep 15 07:42:16.472346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:42:16.474941 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Returning 404 to user: Instance 417dfb32-7368-4c35-8631-f0ca8b7e2680 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:42:16.484244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-24cb1348-7b99-4d00-a378-4c3ddf08db6a tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680" status: 404 len: 111 microversion: 2.1 time: 0.053771 Sep 15 07:42:16.484244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 239/465] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:16 2022] GET /compute/v2.1/servers/417dfb32-7368-4c35-8631-f0ca8b7e2680 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:42:16.526585 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-475b4ced-00b5-4e57-aa68-bff1258fa2fb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:16.535039 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-475b4ced-00b5-4e57-aa68-bff1258fa2fb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1306 microversion: 2.1 time: 0.154743 Sep 15 07:42:16.536531 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 227/466] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:16 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:16.924097 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:16.927732 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:16.931420 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:16.931973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:16.932495 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:16.933195 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:16.933701 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:16.934127 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:16.970863 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:16.971239 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:16.971668 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:16.972146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lazy-loading 'fault' on Instance uuid 37cd67df-dd0e-4658-9b80-3c29efd65897 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:42:17.010957 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5f333f81-b3f8-4d54-b5da-a850f81f8c00 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:17.011576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5f333f81-b3f8-4d54-b5da-a850f81f8c00 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:17.030181 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f333f81-b3f8-4d54-b5da-a850f81f8c00 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:17.030728 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f333f81-b3f8-4d54-b5da-a850f81f8c00 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:17.031186 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f333f81-b3f8-4d54-b5da-a850f81f8c00 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:17.031933 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f333f81-b3f8-4d54-b5da-a850f81f8c00 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:17.032394 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f333f81-b3f8-4d54-b5da-a850f81f8c00 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:17.033590 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5f333f81-b3f8-4d54-b5da-a850f81f8c00 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:17.043316 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:17.051280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f8d833ab-43d3-4f0a-9851-53ba472962a2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 200 len: 1329 microversion: 2.1 time: 0.131304 Sep 15 07:42:17.051986 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 240/467] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:16 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 1329 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:17.107287 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-9c61f4ae-f501-416f-ae4a-a57391a8ab73 req-96a37713-5ecb-4a2b-94e0-d4a569de8e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d61aa0-bcb6-4fe0-bc26-20ef85c5025e", "tag": "a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:17.121542 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-9c61f4ae-f501-416f-ae4a-a57391a8ab73 req-96a37713-5ecb-4a2b-94e0-d4a569de8e1b service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:17.125414 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-9c61f4ae-f501-416f-ae4a-a57391a8ab73 req-96a37713-5ecb-4a2b-94e0-d4a569de8e1b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:17.125414 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-9c61f4ae-f501-416f-ae4a-a57391a8ab73 req-96a37713-5ecb-4a2b-94e0-d4a569de8e1b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:17.135880 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-9c61f4ae-f501-416f-ae4a-a57391a8ab73 req-96a37713-5ecb-4a2b-94e0-d4a569de8e1b service nova] Creating event network-changed:a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14 for instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e on hv-cinder-82414 Sep 15 07:42:17.141297 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-9c61f4ae-f501-416f-ae4a-a57391a8ab73 req-96a37713-5ecb-4a2b-94e0-d4a569de8e1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044978 Sep 15 07:42:17.143454 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 241/468] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:17.151743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-93923ea4-6efb-44a3-9023-d3228c12ba5b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:17.152088 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-93923ea4-6efb-44a3-9023-d3228c12ba5b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:17.158752 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-93923ea4-6efb-44a3-9023-d3228c12ba5b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:17.159587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-93923ea4-6efb-44a3-9023-d3228c12ba5b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:17.160334 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-93923ea4-6efb-44a3-9023-d3228c12ba5b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:17.161338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-93923ea4-6efb-44a3-9023-d3228c12ba5b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:17.162605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-93923ea4-6efb-44a3-9023-d3228c12ba5b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:17.163248 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-93923ea4-6efb-44a3-9023-d3228c12ba5b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:17.332544 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5f333f81-b3f8-4d54-b5da-a850f81f8c00 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:17.341013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5f333f81-b3f8-4d54-b5da-a850f81f8c00 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.334375 Sep 15 07:42:17.349663 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 228/469] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:17 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:17.431285 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-93923ea4-6efb-44a3-9023-d3228c12ba5b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:17.442069 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-93923ea4-6efb-44a3-9023-d3228c12ba5b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.295032 Sep 15 07:42:17.448136 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 242/470] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:17 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:17.565428 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d5671c55-cce4-49e7-9c51-4edb7ad03860 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:17.569955 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d5671c55-cce4-49e7-9c51-4edb7ad03860 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:17.573299 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d5671c55-cce4-49e7-9c51-4edb7ad03860 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:17.573912 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d5671c55-cce4-49e7-9c51-4edb7ad03860 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:17.574584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d5671c55-cce4-49e7-9c51-4edb7ad03860 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:17.575359 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d5671c55-cce4-49e7-9c51-4edb7ad03860 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:17.575884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d5671c55-cce4-49e7-9c51-4edb7ad03860 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:17.576411 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d5671c55-cce4-49e7-9c51-4edb7ad03860 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:17.713062 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d5671c55-cce4-49e7-9c51-4edb7ad03860 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:17.722767 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d5671c55-cce4-49e7-9c51-4edb7ad03860 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1371 microversion: 2.1 time: 0.160905 Sep 15 07:42:17.723501 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 229/471] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:17 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:18.075558 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:18.076457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:18.082899 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:18.083380 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:18.083814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:18.084497 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:18.084947 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:18.085369 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:18.099002 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 HTTP/1.1 Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:42:18.100605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:42:18.102071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '37cd67df-dd0e-4658-9b80-3c29efd65897'} Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:42:18.102938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:42:18.104273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:42:18.105510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:42:18.105510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7cb993ca-6c8c-4668-99a9-dc37b7965c67 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 404 len: 111 microversion: 2.1 time: 0.030466 Sep 15 07:42:18.105510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 243/472] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:18 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:42:18.110934 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b4c898c9-6637-4739-b6af-3a829205c41f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '.version_select at 0x7ff36c9bbe50>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:18.220699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b4c898c9-6637-4739-b6af-3a829205c41f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-124479253" status: 202 len: 0 microversion: 2.1 time: 0.113449 Sep 15 07:42:18.221196 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 230/473] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Sep 15 07:42:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-124479253 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:42:18.364989 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9ac3856b-c553-41bc-8b47-bd861856c28d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:18.365616 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9ac3856b-c553-41bc-8b47-bd861856c28d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:18.371512 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9ac3856b-c553-41bc-8b47-bd861856c28d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:18.371987 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9ac3856b-c553-41bc-8b47-bd861856c28d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:18.372424 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9ac3856b-c553-41bc-8b47-bd861856c28d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:18.373109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9ac3856b-c553-41bc-8b47-bd861856c28d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:18.373566 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9ac3856b-c553-41bc-8b47-bd861856c28d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:18.374007 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9ac3856b-c553-41bc-8b47-bd861856c28d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:18.468284 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-53020ec2-69b3-4db6-a191-7caf84dffcb3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:18.468915 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-53020ec2-69b3-4db6-a191-7caf84dffcb3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:18.476507 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53020ec2-69b3-4db6-a191-7caf84dffcb3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:18.476927 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53020ec2-69b3-4db6-a191-7caf84dffcb3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:18.477543 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53020ec2-69b3-4db6-a191-7caf84dffcb3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:18.478417 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53020ec2-69b3-4db6-a191-7caf84dffcb3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:18.483865 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53020ec2-69b3-4db6-a191-7caf84dffcb3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:18.483865 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53020ec2-69b3-4db6-a191-7caf84dffcb3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:18.649326 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9ac3856b-c553-41bc-8b47-bd861856c28d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:18.657151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9ac3856b-c553-41bc-8b47-bd861856c28d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.297040 Sep 15 07:42:18.657823 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 244/474] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:18 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:18.746463 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e732b697-b8fa-4852-87a6-a241aa295cb2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:18.747091 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e732b697-b8fa-4852-87a6-a241aa295cb2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:18.753055 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-53020ec2-69b3-4db6-a191-7caf84dffcb3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:18.753601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e732b697-b8fa-4852-87a6-a241aa295cb2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:18.753761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e732b697-b8fa-4852-87a6-a241aa295cb2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:18.754250 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e732b697-b8fa-4852-87a6-a241aa295cb2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:18.754958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e732b697-b8fa-4852-87a6-a241aa295cb2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:18.755405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e732b697-b8fa-4852-87a6-a241aa295cb2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:18.755829 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e732b697-b8fa-4852-87a6-a241aa295cb2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:18.761362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-53020ec2-69b3-4db6-a191-7caf84dffcb3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.297031 Sep 15 07:42:18.762186 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 231/475] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:18 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:18.990898 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e732b697-b8fa-4852-87a6-a241aa295cb2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:18.998960 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e732b697-b8fa-4852-87a6-a241aa295cb2 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1371 microversion: 2.1 time: 0.256285 Sep 15 07:42:18.999774 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 245/476] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:18 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:19.181596 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-05cc3795-7f1f-4a7e-94d1-4265e371d647 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: .version_select at 0x7ff36c9f0040>, body: {"keypair": {"name": "tempest-keypair-1130214131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8PSm0ZhOUgUUFkmkP5QzS2pFImh/gpxRx3sQdsyKq2DWHe0PtxQEolew/GxS2/r1x11/6I5/TyA7Qihu/vZBgVtD/m/Q8tHyP1fbLSebIysOcM1h/A+JRCiFWt1dgsRA=="}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:19.197447 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-05cc3795-7f1f-4a7e-94d1-4265e371d647 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for project 14017d5edbbd4068b529d5d92444182a. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:42:19.201369 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-05cc3795-7f1f-4a7e-94d1-4265e371d647 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for user 5e0c8d7aa4db455a94631becf212866f and project 14017d5edbbd4068b529d5d92444182a. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:42:19.277569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-05cc3795-7f1f-4a7e-94d1-4265e371d647 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099730 Sep 15 07:42:19.278132 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 232/477] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 15 07:42:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:42:19.681046 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-86983f24-9453-4233-90b9-026534d1b754 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:19.681694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-86983f24-9453-4233-90b9-026534d1b754 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:19.688144 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-86983f24-9453-4233-90b9-026534d1b754 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:19.688624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-86983f24-9453-4233-90b9-026534d1b754 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:19.689054 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-86983f24-9453-4233-90b9-026534d1b754 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:19.690407 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-86983f24-9453-4233-90b9-026534d1b754 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:19.690948 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-86983f24-9453-4233-90b9-026534d1b754 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:19.691374 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-86983f24-9453-4233-90b9-026534d1b754 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:19.785766 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-75e24bd7-1ad9-49a5-8083-2ce480fcc950 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:19.786442 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-75e24bd7-1ad9-49a5-8083-2ce480fcc950 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:19.792336 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75e24bd7-1ad9-49a5-8083-2ce480fcc950 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:19.797244 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75e24bd7-1ad9-49a5-8083-2ce480fcc950 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:19.797244 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75e24bd7-1ad9-49a5-8083-2ce480fcc950 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:19.797244 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75e24bd7-1ad9-49a5-8083-2ce480fcc950 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:19.797244 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75e24bd7-1ad9-49a5-8083-2ce480fcc950 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:19.797742 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75e24bd7-1ad9-49a5-8083-2ce480fcc950 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:19.829735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-86983f24-9453-4233-90b9-026534d1b754 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:19.838548 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-86983f24-9453-4233-90b9-026534d1b754 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.161318 Sep 15 07:42:19.853788 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 246/478] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:19 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:19.939025 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-75e24bd7-1ad9-49a5-8083-2ce480fcc950 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:19.949107 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-75e24bd7-1ad9-49a5-8083-2ce480fcc950 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.168451 Sep 15 07:42:19.949738 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 233/479] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:19 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:20.024743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-38e32c96-1afb-45d7-a68f-ff639c54ed20 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:20.025625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-38e32c96-1afb-45d7-a68f-ff639c54ed20 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:20.032325 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-38e32c96-1afb-45d7-a68f-ff639c54ed20 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:20.033067 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-38e32c96-1afb-45d7-a68f-ff639c54ed20 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:20.033968 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-38e32c96-1afb-45d7-a68f-ff639c54ed20 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:20.035004 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-38e32c96-1afb-45d7-a68f-ff639c54ed20 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:20.035875 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-38e32c96-1afb-45d7-a68f-ff639c54ed20 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:20.036612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-38e32c96-1afb-45d7-a68f-ff639c54ed20 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:20.285668 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-38e32c96-1afb-45d7-a68f-ff639c54ed20 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:20.300448 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-38e32c96-1afb-45d7-a68f-ff639c54ed20 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1371 microversion: 2.1 time: 0.279672 Sep 15 07:42:20.311035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 247/480] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:20 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:20.862973 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-24c18477-9b78-4a44-aadd-c57593ba5114 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:20.863759 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-24c18477-9b78-4a44-aadd-c57593ba5114 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:20.866164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:20.870928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-24c18477-9b78-4a44-aadd-c57593ba5114 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:20.871394 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-24c18477-9b78-4a44-aadd-c57593ba5114 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:20.871850 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-24c18477-9b78-4a44-aadd-c57593ba5114 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:20.872540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-24c18477-9b78-4a44-aadd-c57593ba5114 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:20.872986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-24c18477-9b78-4a44-aadd-c57593ba5114 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:20.873405 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-24c18477-9b78-4a44-aadd-c57593ba5114 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:20.974999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-be29d17f-8dc4-4e4b-bf8f-8967b03006bb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:20.975625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-be29d17f-8dc4-4e4b-bf8f-8967b03006bb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:20.982650 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be29d17f-8dc4-4e4b-bf8f-8967b03006bb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:20.983427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be29d17f-8dc4-4e4b-bf8f-8967b03006bb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:20.984012 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be29d17f-8dc4-4e4b-bf8f-8967b03006bb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:20.984945 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be29d17f-8dc4-4e4b-bf8f-8967b03006bb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:20.985551 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be29d17f-8dc4-4e4b-bf8f-8967b03006bb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:20.986948 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-be29d17f-8dc4-4e4b-bf8f-8967b03006bb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:21.319873 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-24c18477-9b78-4a44-aadd-c57593ba5114 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:21.328995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-24c18477-9b78-4a44-aadd-c57593ba5114 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.469783 Sep 15 07:42:21.328995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 234/481] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:20 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:21.333229 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-265490ef-b9fb-4b87-befe-a062f708fbbb req-de744e14-c255-452b-905b-add2733341fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a3489f-c5f3-44d4-93c2-da198e8f06f8", "tag": "5143816a-5379-4a8d-ad85-0a16d1348b1e"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:21.353504 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-265490ef-b9fb-4b87-befe-a062f708fbbb req-de744e14-c255-452b-905b-add2733341fa service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:21.354032 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-265490ef-b9fb-4b87-befe-a062f708fbbb req-de744e14-c255-452b-905b-add2733341fa service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:21.354662 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-265490ef-b9fb-4b87-befe-a062f708fbbb req-de744e14-c255-452b-905b-add2733341fa service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:21.362844 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-be29d17f-8dc4-4e4b-bf8f-8967b03006bb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:21.367576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-265490ef-b9fb-4b87-befe-a062f708fbbb req-de744e14-c255-452b-905b-add2733341fa service nova] Creating event network-changed:5143816a-5379-4a8d-ad85-0a16d1348b1e for instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 on hv-cinder-82414 Sep 15 07:42:21.372137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-be29d17f-8dc4-4e4b-bf8f-8967b03006bb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.400996 Sep 15 07:42:21.372698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-265490ef-b9fb-4b87-befe-a062f708fbbb req-de744e14-c255-452b-905b-add2733341fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042883 Sep 15 07:42:21.373006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 248/482] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:20 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:21.373593 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 235/483] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:21.379606 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-46dcf002-4abc-4d05-8e6c-f4190866a30d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:21.380214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-46dcf002-4abc-4d05-8e6c-f4190866a30d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:21.387163 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46dcf002-4abc-4d05-8e6c-f4190866a30d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:21.391598 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46dcf002-4abc-4d05-8e6c-f4190866a30d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:21.391598 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46dcf002-4abc-4d05-8e6c-f4190866a30d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:21.391598 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46dcf002-4abc-4d05-8e6c-f4190866a30d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:21.391598 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46dcf002-4abc-4d05-8e6c-f4190866a30d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:21.392410 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46dcf002-4abc-4d05-8e6c-f4190866a30d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:21.529329 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-46dcf002-4abc-4d05-8e6c-f4190866a30d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:21.539339 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-46dcf002-4abc-4d05-8e6c-f4190866a30d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1371 microversion: 2.1 time: 0.164093 Sep 15 07:42:21.539927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 249/484] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:21 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:22.212810 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-38b48ab3-423f-445d-ae66-803086a322c2 req-aac23919-97c3-4517-9a91-4357679b8953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfb1a22-faac-4d66-874d-e7866a02a054", "name": "network-vif-plugged", "status": "completed", "tag": "64d3dfe8-cb43-42b9-b820-a5af2429b050"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:22.224198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-38b48ab3-423f-445d-ae66-803086a322c2 req-aac23919-97c3-4517-9a91-4357679b8953 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:22.224669 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-38b48ab3-423f-445d-ae66-803086a322c2 req-aac23919-97c3-4517-9a91-4357679b8953 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:22.225095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-38b48ab3-423f-445d-ae66-803086a322c2 req-aac23919-97c3-4517-9a91-4357679b8953 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:22.237175 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-38b48ab3-423f-445d-ae66-803086a322c2 req-aac23919-97c3-4517-9a91-4357679b8953 service nova] Creating event network-vif-plugged:64d3dfe8-cb43-42b9-b820-a5af2429b050 for instance 7cfb1a22-faac-4d66-874d-e7866a02a054 on hv-cinder-82414 Sep 15 07:42:22.241027 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-38b48ab3-423f-445d-ae66-803086a322c2 req-aac23919-97c3-4517-9a91-4357679b8953 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033131 Sep 15 07:42:22.241632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 236/485] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:22.336694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1675640061", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be4fe7de-ab91-47eb-96fc-2000373fe74e"}], "security_groups": [{"name": "tempest-securitygroup--2073119812"}], "key_name": "tempest-keypair-1130214131", "user_data": "}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:22.352971 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b9466038-ecbd-455c-93db-7a4a1d444c53 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:22.353707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b9466038-ecbd-455c-93db-7a4a1d444c53 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:22.360052 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b9466038-ecbd-455c-93db-7a4a1d444c53 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:22.361461 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b9466038-ecbd-455c-93db-7a4a1d444c53 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:22.362033 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b9466038-ecbd-455c-93db-7a4a1d444c53 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:22.362932 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b9466038-ecbd-455c-93db-7a4a1d444c53 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:22.363390 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b9466038-ecbd-455c-93db-7a4a1d444c53 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:22.363816 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b9466038-ecbd-455c-93db-7a4a1d444c53 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:22.443136 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:22.473508 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=8 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:22.500825 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.network.neutron [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] validate_networks() for [('be4fe7de-ab91-47eb-96fc-2000373fe74e', None, None, None, None, None)] {{(pid=132674) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:42:22.581245 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b9466038-ecbd-455c-93db-7a4a1d444c53 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:22.589184 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b9466038-ecbd-455c-93db-7a4a1d444c53 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.240341 Sep 15 07:42:22.589829 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 237/486] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:22 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:22.594320 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-91e56194-be76-4876-a2b7-4df93ffde7ef tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:22.595484 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-91e56194-be76-4876-a2b7-4df93ffde7ef tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:22.601197 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91e56194-be76-4876-a2b7-4df93ffde7ef tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:22.601701 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91e56194-be76-4876-a2b7-4df93ffde7ef tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:22.602134 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91e56194-be76-4876-a2b7-4df93ffde7ef tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:22.602816 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91e56194-be76-4876-a2b7-4df93ffde7ef tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:22.603269 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91e56194-be76-4876-a2b7-4df93ffde7ef tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:22.603736 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91e56194-be76-4876-a2b7-4df93ffde7ef tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:22.810370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-91e56194-be76-4876-a2b7-4df93ffde7ef tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:22.818996 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-91e56194-be76-4876-a2b7-4df93ffde7ef tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.228166 Sep 15 07:42:22.819565 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 238/487] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:22 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:22.833216 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-dfde5737-0692-49ef-af36-e5107ff63ce6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:22.833877 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-dfde5737-0692-49ef-af36-e5107ff63ce6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:22.840008 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dfde5737-0692-49ef-af36-e5107ff63ce6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:22.844130 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dfde5737-0692-49ef-af36-e5107ff63ce6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:22.844130 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dfde5737-0692-49ef-af36-e5107ff63ce6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:22.844130 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dfde5737-0692-49ef-af36-e5107ff63ce6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:22.844130 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dfde5737-0692-49ef-af36-e5107ff63ce6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:22.846280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dfde5737-0692-49ef-af36-e5107ff63ce6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:23.066252 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Flavor limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:42:23.067064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Image limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:42:23.067617 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Flavor pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:42:23.068105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Image pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:42:23.068616 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:42:23.069341 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-dfde5737-0692-49ef-af36-e5107ff63ce6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:23.077236 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-dfde5737-0692-49ef-af36-e5107ff63ce6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1371 microversion: 2.1 time: 0.256469 Sep 15 07:42:23.077783 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:23.077908 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 239/488] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:22 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:23.078418 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:23.079018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:23.079749 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:23.080210 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:23.080640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:23.087551 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:23.098455 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for project 14017d5edbbd4068b529d5d92444182a. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:42:23.102507 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for user 5e0c8d7aa4db455a94631becf212866f and project 14017d5edbbd4068b529d5d92444182a. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:42:23.114325 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Going to run 1 instances... {{(pid=132674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:42:23.116698 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:42:23.282646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-cdba443a-d59f-4d19-823b-3d6b4612bb29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.950133 Sep 15 07:42:23.283255 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 250/489] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:42:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:42:23.294897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1deb5c4f-437b-4863-9bfa-ca372ae8cf41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:23.295506 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-1deb5c4f-437b-4863-9bfa-ca372ae8cf41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:23.365552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-1deb5c4f-437b-4863-9bfa-ca372ae8cf41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:23.372639 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-1deb5c4f-437b-4863-9bfa-ca372ae8cf41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1242 microversion: 2.1 time: 0.081794 Sep 15 07:42:23.373369 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 240/490] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:23 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:23.618425 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c103c7ee-68fd-4ce2-b697-8d765c6c4d0e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:23.619037 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c103c7ee-68fd-4ce2-b697-8d765c6c4d0e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:23.625945 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c103c7ee-68fd-4ce2-b697-8d765c6c4d0e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:23.626617 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c103c7ee-68fd-4ce2-b697-8d765c6c4d0e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:23.627192 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c103c7ee-68fd-4ce2-b697-8d765c6c4d0e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:23.627889 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c103c7ee-68fd-4ce2-b697-8d765c6c4d0e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:23.628344 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c103c7ee-68fd-4ce2-b697-8d765c6c4d0e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:23.628789 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c103c7ee-68fd-4ce2-b697-8d765c6c4d0e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:23.763705 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c103c7ee-68fd-4ce2-b697-8d765c6c4d0e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:23.771503 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c103c7ee-68fd-4ce2-b697-8d765c6c4d0e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.157552 Sep 15 07:42:23.772063 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 251/491] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:23 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:23.853749 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e3c2f13a-a75f-4de3-8764-1339792b901c tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:23.854269 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e3c2f13a-a75f-4de3-8764-1339792b901c tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:23.861167 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e3c2f13a-a75f-4de3-8764-1339792b901c tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:23.861846 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e3c2f13a-a75f-4de3-8764-1339792b901c tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:23.862275 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e3c2f13a-a75f-4de3-8764-1339792b901c tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:23.862954 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e3c2f13a-a75f-4de3-8764-1339792b901c tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:23.863401 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e3c2f13a-a75f-4de3-8764-1339792b901c tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:23.863819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e3c2f13a-a75f-4de3-8764-1339792b901c tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:23.869557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=100 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:24.003153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e3c2f13a-a75f-4de3-8764-1339792b901c tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:24.011472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e3c2f13a-a75f-4de3-8764-1339792b901c tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.161814 Sep 15 07:42:24.012362 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 241/492] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:23 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:24.100629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6755ddbc-cceb-4185-9e6e-e124cd9b8b55 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:24.101229 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6755ddbc-cceb-4185-9e6e-e124cd9b8b55 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:24.103150 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:24.107952 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6755ddbc-cceb-4185-9e6e-e124cd9b8b55 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:24.108376 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6755ddbc-cceb-4185-9e6e-e124cd9b8b55 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:24.108812 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6755ddbc-cceb-4185-9e6e-e124cd9b8b55 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:24.109493 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6755ddbc-cceb-4185-9e6e-e124cd9b8b55 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:24.111485 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6755ddbc-cceb-4185-9e6e-e124cd9b8b55 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:24.111913 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6755ddbc-cceb-4185-9e6e-e124cd9b8b55 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:24.246916 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6755ddbc-cceb-4185-9e6e-e124cd9b8b55 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:24.255342 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6755ddbc-cceb-4185-9e6e-e124cd9b8b55 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1371 microversion: 2.1 time: 0.158543 Sep 15 07:42:24.255906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 252/493] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:24 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:24.396355 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-475e4841-9741-47fe-b5dd-8dfea37794d1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:24.396901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-475e4841-9741-47fe-b5dd-8dfea37794d1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:24.403450 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475e4841-9741-47fe-b5dd-8dfea37794d1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:24.403934 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475e4841-9741-47fe-b5dd-8dfea37794d1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:24.404374 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475e4841-9741-47fe-b5dd-8dfea37794d1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:24.405067 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475e4841-9741-47fe-b5dd-8dfea37794d1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:24.405522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475e4841-9741-47fe-b5dd-8dfea37794d1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:24.405973 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-475e4841-9741-47fe-b5dd-8dfea37794d1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:24.466415 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-475e4841-9741-47fe-b5dd-8dfea37794d1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:24.474455 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-475e4841-9741-47fe-b5dd-8dfea37794d1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1246 microversion: 2.1 time: 0.082372 Sep 15 07:42:24.475021 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 242/494] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:24 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:24.794706 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1182eea2-97f1-4fb2-a348-356995d587c6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:24.799437 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1182eea2-97f1-4fb2-a348-356995d587c6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:24.802334 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1182eea2-97f1-4fb2-a348-356995d587c6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:24.802873 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1182eea2-97f1-4fb2-a348-356995d587c6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:24.803312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1182eea2-97f1-4fb2-a348-356995d587c6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:24.803998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1182eea2-97f1-4fb2-a348-356995d587c6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:24.804455 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1182eea2-97f1-4fb2-a348-356995d587c6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:24.804878 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1182eea2-97f1-4fb2-a348-356995d587c6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:24.944781 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1182eea2-97f1-4fb2-a348-356995d587c6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:24.952641 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1182eea2-97f1-4fb2-a348-356995d587c6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.161785 Sep 15 07:42:24.953762 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 253/495] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:24 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:25.036267 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c3f9e8a8-c991-4c4e-b149-8343db3549ee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:25.036803 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c3f9e8a8-c991-4c4e-b149-8343db3549ee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:25.045032 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c3f9e8a8-c991-4c4e-b149-8343db3549ee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:25.045527 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c3f9e8a8-c991-4c4e-b149-8343db3549ee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:25.046069 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c3f9e8a8-c991-4c4e-b149-8343db3549ee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:25.046715 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c3f9e8a8-c991-4c4e-b149-8343db3549ee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:25.047258 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c3f9e8a8-c991-4c4e-b149-8343db3549ee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:25.047686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c3f9e8a8-c991-4c4e-b149-8343db3549ee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:25.177740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c3f9e8a8-c991-4c4e-b149-8343db3549ee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:25.185330 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c3f9e8a8-c991-4c4e-b149-8343db3549ee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.154044 Sep 15 07:42:25.185926 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 243/496] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:25 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:25.278255 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-cb6c6881-e37c-4d92-977b-106662c37f54 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:25.278874 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-cb6c6881-e37c-4d92-977b-106662c37f54 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:25.285455 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cb6c6881-e37c-4d92-977b-106662c37f54 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:25.286061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cb6c6881-e37c-4d92-977b-106662c37f54 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:25.286553 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cb6c6881-e37c-4d92-977b-106662c37f54 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:25.287185 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cb6c6881-e37c-4d92-977b-106662c37f54 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:25.287638 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cb6c6881-e37c-4d92-977b-106662c37f54 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:25.288061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cb6c6881-e37c-4d92-977b-106662c37f54 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:25.426277 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-cb6c6881-e37c-4d92-977b-106662c37f54 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:25.434443 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-cb6c6881-e37c-4d92-977b-106662c37f54 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1371 microversion: 2.1 time: 0.159696 Sep 15 07:42:25.435005 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 254/497] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:25 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:25.499029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-dd30b5ba-cffb-49dd-be8e-b9b619aedb41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:25.500397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-dd30b5ba-cffb-49dd-be8e-b9b619aedb41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:25.506721 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd30b5ba-cffb-49dd-be8e-b9b619aedb41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:25.507212 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd30b5ba-cffb-49dd-be8e-b9b619aedb41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:25.507655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd30b5ba-cffb-49dd-be8e-b9b619aedb41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:25.508343 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd30b5ba-cffb-49dd-be8e-b9b619aedb41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:25.508796 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd30b5ba-cffb-49dd-be8e-b9b619aedb41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:25.509219 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dd30b5ba-cffb-49dd-be8e-b9b619aedb41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:25.574183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-dd30b5ba-cffb-49dd-be8e-b9b619aedb41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:25.582823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-dd30b5ba-cffb-49dd-be8e-b9b619aedb41 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1246 microversion: 2.1 time: 0.087662 Sep 15 07:42:25.583391 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 244/498] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:25 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:25.978219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1963886b-b3bc-45f7-bc83-8cf2715f9c65 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:25.979652 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1963886b-b3bc-45f7-bc83-8cf2715f9c65 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:25.985604 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1963886b-b3bc-45f7-bc83-8cf2715f9c65 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:25.986113 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1963886b-b3bc-45f7-bc83-8cf2715f9c65 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:25.989859 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1963886b-b3bc-45f7-bc83-8cf2715f9c65 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:25.989859 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1963886b-b3bc-45f7-bc83-8cf2715f9c65 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:25.989859 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1963886b-b3bc-45f7-bc83-8cf2715f9c65 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:25.989859 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1963886b-b3bc-45f7-bc83-8cf2715f9c65 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:26.080241 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1142756276", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "networks": [{"uuid": "f394ac71-7474-4bf4-a880-a8c13e331ffa"}]}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:26.140449 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] validate_networks() for [('f394ac71-7474-4bf4-a880-a8c13e331ffa', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:42:26.140559 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1963886b-b3bc-45f7-bc83-8cf2715f9c65 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:26.148500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1963886b-b3bc-45f7-bc83-8cf2715f9c65 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.176593 Sep 15 07:42:26.149073 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 255/499] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:25 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:26.210442 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7b730f0c-9862-4dae-8773-0c367f8d94e7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:26.211597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7b730f0c-9862-4dae-8773-0c367f8d94e7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:26.218017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b730f0c-9862-4dae-8773-0c367f8d94e7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:26.219542 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b730f0c-9862-4dae-8773-0c367f8d94e7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:26.220387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b730f0c-9862-4dae-8773-0c367f8d94e7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:26.221466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b730f0c-9862-4dae-8773-0c367f8d94e7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:26.222191 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b730f0c-9862-4dae-8773-0c367f8d94e7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:26.222852 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b730f0c-9862-4dae-8773-0c367f8d94e7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:26.443501 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7b730f0c-9862-4dae-8773-0c367f8d94e7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:26.452721 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7b730f0c-9862-4dae-8773-0c367f8d94e7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.246390 Sep 15 07:42:26.453977 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 256/500] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:26 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:26.458539 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-22db57c6-7b37-4121-b95b-fbb28a67f920 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:26.459259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-22db57c6-7b37-4121-b95b-fbb28a67f920 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:26.466010 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22db57c6-7b37-4121-b95b-fbb28a67f920 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:26.466492 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22db57c6-7b37-4121-b95b-fbb28a67f920 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:26.473371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22db57c6-7b37-4121-b95b-fbb28a67f920 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:26.473371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22db57c6-7b37-4121-b95b-fbb28a67f920 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:26.473371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22db57c6-7b37-4121-b95b-fbb28a67f920 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:26.473371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22db57c6-7b37-4121-b95b-fbb28a67f920 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:26.625943 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:42:26.626947 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:42:26.627239 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:42:26.627888 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:42:26.628408 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:42:26.640422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:26.641037 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:26.641476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:26.642334 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:26.642815 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:26.643234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:26.656430 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-22db57c6-7b37-4121-b95b-fbb28a67f920 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:26.663376 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Getting quotas for project 66cb9c7c7eb24e30bf89b3680c713472. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:42:26.665169 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-22db57c6-7b37-4121-b95b-fbb28a67f920 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1371 microversion: 2.1 time: 0.210181 Sep 15 07:42:26.665791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 257/501] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:26 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:26.667488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Getting quotas for user ae7e3a9a28134a28a3f8f30d4b0fcb8c and project 66cb9c7c7eb24e30bf89b3680c713472. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:42:26.680055 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:42:26.682763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:42:26.685904 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5e3ed4a7-8829-4f77-a7b6-a8b1ff312c92 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:26.686523 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5e3ed4a7-8829-4f77-a7b6-a8b1ff312c92 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:26.693204 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e3ed4a7-8829-4f77-a7b6-a8b1ff312c92 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:26.693644 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e3ed4a7-8829-4f77-a7b6-a8b1ff312c92 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:26.694088 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e3ed4a7-8829-4f77-a7b6-a8b1ff312c92 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:26.694976 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e3ed4a7-8829-4f77-a7b6-a8b1ff312c92 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:26.695437 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e3ed4a7-8829-4f77-a7b6-a8b1ff312c92 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:26.695873 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5e3ed4a7-8829-4f77-a7b6-a8b1ff312c92 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:26.762190 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5e3ed4a7-8829-4f77-a7b6-a8b1ff312c92 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:26.771089 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5e3ed4a7-8829-4f77-a7b6-a8b1ff312c92 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1238 microversion: 2.1 time: 0.088863 Sep 15 07:42:26.771666 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 258/502] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:26 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1238 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:26.799316 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3077a195-d993-4f82-887e-a00bf06065f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723241 Sep 15 07:42:26.800079 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 245/503] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:42:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 07:42:26.811003 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d17b20d4-7ba0-450b-b4d7-c2534c15d8f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:26.812990 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d17b20d4-7ba0-450b-b4d7-c2534c15d8f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:26.866549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d17b20d4-7ba0-450b-b4d7-c2534c15d8f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:26.873379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d17b20d4-7ba0-450b-b4d7-c2534c15d8f6 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1219 microversion: 2.1 time: 0.066139 Sep 15 07:42:26.876567 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 259/504] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:26 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:27.172807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e6debc60-5cd3-4302-be5b-2cf79d0d0d5c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:27.173427 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e6debc60-5cd3-4302-be5b-2cf79d0d0d5c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:27.180021 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e6debc60-5cd3-4302-be5b-2cf79d0d0d5c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:27.180592 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e6debc60-5cd3-4302-be5b-2cf79d0d0d5c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:27.181027 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e6debc60-5cd3-4302-be5b-2cf79d0d0d5c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:27.181750 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e6debc60-5cd3-4302-be5b-2cf79d0d0d5c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:27.182235 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e6debc60-5cd3-4302-be5b-2cf79d0d0d5c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:27.182660 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e6debc60-5cd3-4302-be5b-2cf79d0d0d5c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:27.318108 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e6debc60-5cd3-4302-be5b-2cf79d0d0d5c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:27.325688 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e6debc60-5cd3-4302-be5b-2cf79d0d0d5c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1266 microversion: 2.1 time: 0.156948 Sep 15 07:42:27.326275 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 246/505] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:27 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:27.476392 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-01e309d3-d10b-40e8-85d0-cf2a33a72147 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:27.477013 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-01e309d3-d10b-40e8-85d0-cf2a33a72147 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:27.485044 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-01e309d3-d10b-40e8-85d0-cf2a33a72147 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:27.485524 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-01e309d3-d10b-40e8-85d0-cf2a33a72147 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:27.485997 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-01e309d3-d10b-40e8-85d0-cf2a33a72147 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:27.486686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-01e309d3-d10b-40e8-85d0-cf2a33a72147 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:27.487206 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-01e309d3-d10b-40e8-85d0-cf2a33a72147 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:27.487632 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-01e309d3-d10b-40e8-85d0-cf2a33a72147 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:27.626126 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-01e309d3-d10b-40e8-85d0-cf2a33a72147 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:27.633793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-01e309d3-d10b-40e8-85d0-cf2a33a72147 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.161316 Sep 15 07:42:27.634350 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 260/506] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:27 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:27.689019 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f160ba1e-0ac5-40b5-a47a-a2a78f36c71a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:27.689669 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f160ba1e-0ac5-40b5-a47a-a2a78f36c71a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:27.696138 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f160ba1e-0ac5-40b5-a47a-a2a78f36c71a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:27.696617 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f160ba1e-0ac5-40b5-a47a-a2a78f36c71a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:27.697052 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f160ba1e-0ac5-40b5-a47a-a2a78f36c71a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:27.697770 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f160ba1e-0ac5-40b5-a47a-a2a78f36c71a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:27.698222 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f160ba1e-0ac5-40b5-a47a-a2a78f36c71a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:27.698747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f160ba1e-0ac5-40b5-a47a-a2a78f36c71a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:27.794642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ac6b3eaf-0fa2-404f-98cc-1347e3082484 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:27.795252 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ac6b3eaf-0fa2-404f-98cc-1347e3082484 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:27.802206 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac6b3eaf-0fa2-404f-98cc-1347e3082484 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:27.802685 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac6b3eaf-0fa2-404f-98cc-1347e3082484 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:27.803121 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac6b3eaf-0fa2-404f-98cc-1347e3082484 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:27.803807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac6b3eaf-0fa2-404f-98cc-1347e3082484 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:27.804251 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac6b3eaf-0fa2-404f-98cc-1347e3082484 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:27.804667 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac6b3eaf-0fa2-404f-98cc-1347e3082484 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:27.830431 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f160ba1e-0ac5-40b5-a47a-a2a78f36c71a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:27.838397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f160ba1e-0ac5-40b5-a47a-a2a78f36c71a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1371 microversion: 2.1 time: 0.153946 Sep 15 07:42:27.839140 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 247/507] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:27 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:27.873777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ac6b3eaf-0fa2-404f-98cc-1347e3082484 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:27.883587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ac6b3eaf-0fa2-404f-98cc-1347e3082484 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1294 microversion: 2.1 time: 0.092777 Sep 15 07:42:27.884170 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 261/508] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:27 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:27.899933 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-434926cd-0f1b-468b-b7bc-47af39b6ea5c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:27.900570 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-434926cd-0f1b-468b-b7bc-47af39b6ea5c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:27.906650 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-434926cd-0f1b-468b-b7bc-47af39b6ea5c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:27.907129 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-434926cd-0f1b-468b-b7bc-47af39b6ea5c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:27.907824 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-434926cd-0f1b-468b-b7bc-47af39b6ea5c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:27.908505 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-434926cd-0f1b-468b-b7bc-47af39b6ea5c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:27.908952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-434926cd-0f1b-468b-b7bc-47af39b6ea5c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:27.909370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-434926cd-0f1b-468b-b7bc-47af39b6ea5c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:27.977361 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-434926cd-0f1b-468b-b7bc-47af39b6ea5c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:27.997765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-434926cd-0f1b-468b-b7bc-47af39b6ea5c tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1223 microversion: 2.1 time: 0.100816 Sep 15 07:42:27.999325 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 248/509] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:27 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:28.235885 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-be6d5f93-6913-426b-bae4-2f7b68f23b68 req-d3cfb8f3-de2a-48fb-82f9-67908f6a65c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a3489f-c5f3-44d4-93c2-da198e8f06f8", "name": "network-vif-plugged", "status": "completed", "tag": "5143816a-5379-4a8d-ad85-0a16d1348b1e"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:28.245270 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-be6d5f93-6913-426b-bae4-2f7b68f23b68 req-d3cfb8f3-de2a-48fb-82f9-67908f6a65c0 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:28.245784 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-be6d5f93-6913-426b-bae4-2f7b68f23b68 req-d3cfb8f3-de2a-48fb-82f9-67908f6a65c0 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:28.246347 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-be6d5f93-6913-426b-bae4-2f7b68f23b68 req-d3cfb8f3-de2a-48fb-82f9-67908f6a65c0 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:28.258407 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-be6d5f93-6913-426b-bae4-2f7b68f23b68 req-d3cfb8f3-de2a-48fb-82f9-67908f6a65c0 service nova] Creating event network-vif-plugged:5143816a-5379-4a8d-ad85-0a16d1348b1e for instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 on hv-cinder-82414 Sep 15 07:42:28.263318 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-be6d5f93-6913-426b-bae4-2f7b68f23b68 req-d3cfb8f3-de2a-48fb-82f9-67908f6a65c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031944 Sep 15 07:42:28.263894 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 262/510] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:28.349994 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1fa8a34d-eef8-43e2-a6b1-61a88c1296db tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:28.350619 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-1fa8a34d-eef8-43e2-a6b1-61a88c1296db tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:28.365157 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1fa8a34d-eef8-43e2-a6b1-61a88c1296db tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:28.365723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1fa8a34d-eef8-43e2-a6b1-61a88c1296db tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:28.367053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1fa8a34d-eef8-43e2-a6b1-61a88c1296db tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:28.367780 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1fa8a34d-eef8-43e2-a6b1-61a88c1296db tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:28.368231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1fa8a34d-eef8-43e2-a6b1-61a88c1296db tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:28.368651 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1fa8a34d-eef8-43e2-a6b1-61a88c1296db tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:28.510370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-1fa8a34d-eef8-43e2-a6b1-61a88c1296db tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:28.518680 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-1fa8a34d-eef8-43e2-a6b1-61a88c1296db tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1452 microversion: 2.1 time: 0.172994 Sep 15 07:42:28.519249 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 249/511] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:28 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:28.542369 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-aa2fbd65-7767-4c5e-8f69-0e3024ca41e3 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:28.543211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-aa2fbd65-7767-4c5e-8f69-0e3024ca41e3 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:28.550522 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aa2fbd65-7767-4c5e-8f69-0e3024ca41e3 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:28.551286 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aa2fbd65-7767-4c5e-8f69-0e3024ca41e3 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:28.551718 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aa2fbd65-7767-4c5e-8f69-0e3024ca41e3 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:28.554843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aa2fbd65-7767-4c5e-8f69-0e3024ca41e3 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:28.554843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aa2fbd65-7767-4c5e-8f69-0e3024ca41e3 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:28.554843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aa2fbd65-7767-4c5e-8f69-0e3024ca41e3 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:28.659073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-51c92067-e49c-4b9a-b8a5-49a2f68b44ce tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:28.660097 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-51c92067-e49c-4b9a-b8a5-49a2f68b44ce tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:28.666330 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-51c92067-e49c-4b9a-b8a5-49a2f68b44ce tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:28.666822 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-51c92067-e49c-4b9a-b8a5-49a2f68b44ce tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:28.667309 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-51c92067-e49c-4b9a-b8a5-49a2f68b44ce tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:28.668191 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-51c92067-e49c-4b9a-b8a5-49a2f68b44ce tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:28.668806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-51c92067-e49c-4b9a-b8a5-49a2f68b44ce tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:28.669485 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-51c92067-e49c-4b9a-b8a5-49a2f68b44ce tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:28.791076 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-aa2fbd65-7767-4c5e-8f69-0e3024ca41e3 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:28.801309 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-aa2fbd65-7767-4c5e-8f69-0e3024ca41e3 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1452 microversion: 2.1 time: 0.263564 Sep 15 07:42:28.802479 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 263/512] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:28 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1452 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:28.861830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5804785d-4128-49d8-ad42-6665f78d8c60 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:28.862442 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5804785d-4128-49d8-ad42-6665f78d8c60 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:28.868640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5804785d-4128-49d8-ad42-6665f78d8c60 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:28.869129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5804785d-4128-49d8-ad42-6665f78d8c60 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:28.869558 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5804785d-4128-49d8-ad42-6665f78d8c60 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:28.870441 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5804785d-4128-49d8-ad42-6665f78d8c60 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:28.871079 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5804785d-4128-49d8-ad42-6665f78d8c60 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:28.871504 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5804785d-4128-49d8-ad42-6665f78d8c60 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:28.898946 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-51c92067-e49c-4b9a-b8a5-49a2f68b44ce tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:28.908498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-51c92067-e49c-4b9a-b8a5-49a2f68b44ce tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.254637 Sep 15 07:42:28.909717 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 250/513] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:28 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:28.914927 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-43a60b8e-cadd-49a5-aa17-c29163d59531 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:28.915765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-43a60b8e-cadd-49a5-aa17-c29163d59531 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:28.924149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-43a60b8e-cadd-49a5-aa17-c29163d59531 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:28.925014 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-43a60b8e-cadd-49a5-aa17-c29163d59531 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:28.926015 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-43a60b8e-cadd-49a5-aa17-c29163d59531 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:28.927199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-43a60b8e-cadd-49a5-aa17-c29163d59531 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:28.927819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-43a60b8e-cadd-49a5-aa17-c29163d59531 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:28.928613 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-43a60b8e-cadd-49a5-aa17-c29163d59531 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:29.008946 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-43a60b8e-cadd-49a5-aa17-c29163d59531 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:29.016701 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-43a60b8e-cadd-49a5-aa17-c29163d59531 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1312 microversion: 2.1 time: 0.105585 Sep 15 07:42:29.030860 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 251/514] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:28 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:29.041060 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-da3105b5-5f21-42a6-bd81-81ec9a48e7c1 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:29.042606 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-da3105b5-5f21-42a6-bd81-81ec9a48e7c1 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:29.049981 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da3105b5-5f21-42a6-bd81-81ec9a48e7c1 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:29.050828 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da3105b5-5f21-42a6-bd81-81ec9a48e7c1 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:29.051421 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da3105b5-5f21-42a6-bd81-81ec9a48e7c1 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:29.052333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da3105b5-5f21-42a6-bd81-81ec9a48e7c1 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:29.052981 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da3105b5-5f21-42a6-bd81-81ec9a48e7c1 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:29.053797 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da3105b5-5f21-42a6-bd81-81ec9a48e7c1 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:29.110246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5804785d-4128-49d8-ad42-6665f78d8c60 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:29.118240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5804785d-4128-49d8-ad42-6665f78d8c60 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1371 microversion: 2.1 time: 0.260012 Sep 15 07:42:29.126918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 264/515] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:28 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:29.146484 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-da3105b5-5f21-42a6-bd81-81ec9a48e7c1 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:29.154420 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-da3105b5-5f21-42a6-bd81-81ec9a48e7c1 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1271 microversion: 2.1 time: 0.122154 Sep 15 07:42:29.155192 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 252/516] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:29 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:29.933548 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-598eb4f1-a6a1-4840-bb9a-e85e9675bfe7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:29.934909 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-598eb4f1-a6a1-4840-bb9a-e85e9675bfe7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:29.943395 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-598eb4f1-a6a1-4840-bb9a-e85e9675bfe7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:29.946803 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-598eb4f1-a6a1-4840-bb9a-e85e9675bfe7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:29.947461 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-598eb4f1-a6a1-4840-bb9a-e85e9675bfe7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:29.948863 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-598eb4f1-a6a1-4840-bb9a-e85e9675bfe7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:29.949480 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-598eb4f1-a6a1-4840-bb9a-e85e9675bfe7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:29.950585 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-598eb4f1-a6a1-4840-bb9a-e85e9675bfe7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:30.053550 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d1ef42ca-8b31-492d-a657-6649210ae1a8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:30.054219 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d1ef42ca-8b31-492d-a657-6649210ae1a8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:30.064692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1ef42ca-8b31-492d-a657-6649210ae1a8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:30.064692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1ef42ca-8b31-492d-a657-6649210ae1a8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:30.064692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1ef42ca-8b31-492d-a657-6649210ae1a8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:30.064692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1ef42ca-8b31-492d-a657-6649210ae1a8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:30.065193 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1ef42ca-8b31-492d-a657-6649210ae1a8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:30.065193 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1ef42ca-8b31-492d-a657-6649210ae1a8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:30.297845 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-598eb4f1-a6a1-4840-bb9a-e85e9675bfe7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:30.314485 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-598eb4f1-a6a1-4840-bb9a-e85e9675bfe7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.385892 Sep 15 07:42:30.315472 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 265/517] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:29 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:30.320061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0cfeb9b7-81a9-4373-99f7-35b97a129ebf tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:30.320698 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0cfeb9b7-81a9-4373-99f7-35b97a129ebf tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:30.336942 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cfeb9b7-81a9-4373-99f7-35b97a129ebf tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:30.337754 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cfeb9b7-81a9-4373-99f7-35b97a129ebf tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:30.338353 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cfeb9b7-81a9-4373-99f7-35b97a129ebf tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:30.339211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cfeb9b7-81a9-4373-99f7-35b97a129ebf tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:30.343434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cfeb9b7-81a9-4373-99f7-35b97a129ebf tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:30.344060 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cfeb9b7-81a9-4373-99f7-35b97a129ebf tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:30.488772 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d1ef42ca-8b31-492d-a657-6649210ae1a8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:30.497359 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d1ef42ca-8b31-492d-a657-6649210ae1a8 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1368 microversion: 2.1 time: 0.448360 Sep 15 07:42:30.498740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 253/518] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:30 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1368 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:30.503820 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-801c11dd-38b1-414e-987d-8d8d02d353d2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:30.504604 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-801c11dd-38b1-414e-987d-8d8d02d353d2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:30.511484 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-801c11dd-38b1-414e-987d-8d8d02d353d2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:30.512147 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-801c11dd-38b1-414e-987d-8d8d02d353d2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:30.512761 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-801c11dd-38b1-414e-987d-8d8d02d353d2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:30.513770 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-801c11dd-38b1-414e-987d-8d8d02d353d2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:30.514576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-801c11dd-38b1-414e-987d-8d8d02d353d2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:30.515798 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-801c11dd-38b1-414e-987d-8d8d02d353d2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:30.623673 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-801c11dd-38b1-414e-987d-8d8d02d353d2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:30.627343 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0cfeb9b7-81a9-4373-99f7-35b97a129ebf tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:30.643921 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-801c11dd-38b1-414e-987d-8d8d02d353d2 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1279 microversion: 2.1 time: 0.143715 Sep 15 07:42:30.645457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0cfeb9b7-81a9-4373-99f7-35b97a129ebf tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1371 microversion: 2.1 time: 0.328404 Sep 15 07:42:30.646436 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 266/519] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:30 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1371 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:30.646940 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 254/520] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:30 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:30.651391 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-be729498-0464-41ee-9268-25e69bef08d7 req-15dc5534-878c-4e95-9405-d4d778b591f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a02c55-496c-4b57-9af0-d40fba32857e", "tag": "590166b6-cdd3-443d-ba8a-e41ad7c63879"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:30.661386 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-be729498-0464-41ee-9268-25e69bef08d7 req-15dc5534-878c-4e95-9405-d4d778b591f4 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:30.661904 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-be729498-0464-41ee-9268-25e69bef08d7 req-15dc5534-878c-4e95-9405-d4d778b591f4 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:30.662330 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-be729498-0464-41ee-9268-25e69bef08d7 req-15dc5534-878c-4e95-9405-d4d778b591f4 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:30.696030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-be729498-0464-41ee-9268-25e69bef08d7 req-15dc5534-878c-4e95-9405-d4d778b591f4 service nova] Creating event network-changed:590166b6-cdd3-443d-ba8a-e41ad7c63879 for instance 93a02c55-496c-4b57-9af0-d40fba32857e on hv-cinder-82414 Sep 15 07:42:30.702224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-be729498-0464-41ee-9268-25e69bef08d7 req-15dc5534-878c-4e95-9405-d4d778b591f4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054123 Sep 15 07:42:30.709626 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 267/521] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:31.339928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3f24067f-f777-4f6d-aee6-54b80256b512 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:31.340640 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3f24067f-f777-4f6d-aee6-54b80256b512 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:31.347992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3f24067f-f777-4f6d-aee6-54b80256b512 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:31.348612 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3f24067f-f777-4f6d-aee6-54b80256b512 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:31.349049 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3f24067f-f777-4f6d-aee6-54b80256b512 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:31.349773 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3f24067f-f777-4f6d-aee6-54b80256b512 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:31.350225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3f24067f-f777-4f6d-aee6-54b80256b512 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:31.350648 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3f24067f-f777-4f6d-aee6-54b80256b512 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:31.525311 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0cc8470a-a0cb-4b0d-835b-fe54f53df28f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:31.526737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0cc8470a-a0cb-4b0d-835b-fe54f53df28f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:31.536521 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cc8470a-a0cb-4b0d-835b-fe54f53df28f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:31.537326 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cc8470a-a0cb-4b0d-835b-fe54f53df28f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:31.537990 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cc8470a-a0cb-4b0d-835b-fe54f53df28f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:31.538696 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cc8470a-a0cb-4b0d-835b-fe54f53df28f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:31.539301 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cc8470a-a0cb-4b0d-835b-fe54f53df28f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:31.539875 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0cc8470a-a0cb-4b0d-835b-fe54f53df28f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:31.787315 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3f24067f-f777-4f6d-aee6-54b80256b512 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:31.796385 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3f24067f-f777-4f6d-aee6-54b80256b512 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.460343 Sep 15 07:42:31.796970 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 255/522] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:31 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:31.803490 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f648c4c8-4f7e-4584-b624-333e3e155014 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:31.804458 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f648c4c8-4f7e-4584-b624-333e3e155014 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:31.812193 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f648c4c8-4f7e-4584-b624-333e3e155014 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:31.812913 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f648c4c8-4f7e-4584-b624-333e3e155014 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:31.813342 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f648c4c8-4f7e-4584-b624-333e3e155014 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:31.814207 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f648c4c8-4f7e-4584-b624-333e3e155014 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:31.814660 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f648c4c8-4f7e-4584-b624-333e3e155014 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:31.815167 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f648c4c8-4f7e-4584-b624-333e3e155014 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:31.952841 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0cc8470a-a0cb-4b0d-835b-fe54f53df28f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:31.961112 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0cc8470a-a0cb-4b0d-835b-fe54f53df28f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1368 microversion: 2.1 time: 0.441634 Sep 15 07:42:31.961724 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 268/523] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:31 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1368 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:31.981770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c5fafc9e-b9fe-40c8-b4c4-71f20b19a46f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:31.982388 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c5fafc9e-b9fe-40c8-b4c4-71f20b19a46f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:31.991610 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5fafc9e-b9fe-40c8-b4c4-71f20b19a46f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:31.992122 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5fafc9e-b9fe-40c8-b4c4-71f20b19a46f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:31.992541 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5fafc9e-b9fe-40c8-b4c4-71f20b19a46f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:31.994314 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5fafc9e-b9fe-40c8-b4c4-71f20b19a46f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:31.994888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5fafc9e-b9fe-40c8-b4c4-71f20b19a46f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:31.995424 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c5fafc9e-b9fe-40c8-b4c4-71f20b19a46f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:32.118544 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f648c4c8-4f7e-4584-b624-333e3e155014 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:32.129147 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f648c4c8-4f7e-4584-b624-333e3e155014 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1565 microversion: 2.1 time: 0.330727 Sep 15 07:42:32.142871 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 256/524] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:31 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1565 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:32.156839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-de4fd1a9-e7a2-4cc9-aedf-68cb74f49f74 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:32.157397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-de4fd1a9-e7a2-4cc9-aedf-68cb74f49f74 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:32.182497 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-de4fd1a9-e7a2-4cc9-aedf-68cb74f49f74 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:32.183139 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-de4fd1a9-e7a2-4cc9-aedf-68cb74f49f74 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:32.183700 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-de4fd1a9-e7a2-4cc9-aedf-68cb74f49f74 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:32.184536 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-de4fd1a9-e7a2-4cc9-aedf-68cb74f49f74 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:32.186337 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-de4fd1a9-e7a2-4cc9-aedf-68cb74f49f74 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:32.186337 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-de4fd1a9-e7a2-4cc9-aedf-68cb74f49f74 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:32.256153 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c5fafc9e-b9fe-40c8-b4c4-71f20b19a46f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:32.264749 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:32.267938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c5fafc9e-b9fe-40c8-b4c4-71f20b19a46f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1319 microversion: 2.1 time: 0.290082 Sep 15 07:42:32.270069 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 269/525] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:31 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:32.306437 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-baa76b33-936a-4045-8e64-2999d49a45ac req-5f25ea55-3c1c-4a41-b046-6b3be851ef6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d61aa0-bcb6-4fe0-bc26-20ef85c5025e", "name": "network-vif-plugged", "status": "completed", "tag": "a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:32.307982 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-de4fd1a9-e7a2-4cc9-aedf-68cb74f49f74 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157185 Sep 15 07:42:32.317318 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 257/526] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 15 07:42:32 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:32.322884 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-baa76b33-936a-4045-8e64-2999d49a45ac req-5f25ea55-3c1c-4a41-b046-6b3be851ef6c service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:32.322884 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-baa76b33-936a-4045-8e64-2999d49a45ac req-5f25ea55-3c1c-4a41-b046-6b3be851ef6c service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:32.322884 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-baa76b33-936a-4045-8e64-2999d49a45ac req-5f25ea55-3c1c-4a41-b046-6b3be851ef6c service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:32.332044 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-baa76b33-936a-4045-8e64-2999d49a45ac req-5f25ea55-3c1c-4a41-b046-6b3be851ef6c service nova] Creating event network-vif-plugged:a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14 for instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e on hv-cinder-82414 Sep 15 07:42:32.336956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-baa76b33-936a-4045-8e64-2999d49a45ac req-5f25ea55-3c1c-4a41-b046-6b3be851ef6c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036846 Sep 15 07:42:32.337888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 270/527] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:42:32.529485 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-b54e81ae-7f69-4124-aaf8-5f176c0611d5 req-7e612c77-67d5-4965-859c-40c8ebc8610e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfb1a22-faac-4d66-874d-e7866a02a054", "tag": "64d3dfe8-cb43-42b9-b820-a5af2429b050"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:32.540616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-b54e81ae-7f69-4124-aaf8-5f176c0611d5 req-7e612c77-67d5-4965-859c-40c8ebc8610e service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:32.541452 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-b54e81ae-7f69-4124-aaf8-5f176c0611d5 req-7e612c77-67d5-4965-859c-40c8ebc8610e service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:32.542100 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-b54e81ae-7f69-4124-aaf8-5f176c0611d5 req-7e612c77-67d5-4965-859c-40c8ebc8610e service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:32.558017 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-b54e81ae-7f69-4124-aaf8-5f176c0611d5 req-7e612c77-67d5-4965-859c-40c8ebc8610e service nova] Creating event network-changed:64d3dfe8-cb43-42b9-b820-a5af2429b050 for instance 7cfb1a22-faac-4d66-874d-e7866a02a054 on hv-cinder-82414 Sep 15 07:42:32.565292 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-b54e81ae-7f69-4124-aaf8-5f176c0611d5 req-7e612c77-67d5-4965-859c-40c8ebc8610e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041019 Sep 15 07:42:32.566264 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 258/528] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:32.823457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9c2ac606-49ce-4048-a067-c3ce1c3436e6 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:32.824551 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9c2ac606-49ce-4048-a067-c3ce1c3436e6 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:32.832890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9c2ac606-49ce-4048-a067-c3ce1c3436e6 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:32.833494 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9c2ac606-49ce-4048-a067-c3ce1c3436e6 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:32.834104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9c2ac606-49ce-4048-a067-c3ce1c3436e6 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:32.834889 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9c2ac606-49ce-4048-a067-c3ce1c3436e6 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:32.835577 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9c2ac606-49ce-4048-a067-c3ce1c3436e6 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:32.836077 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9c2ac606-49ce-4048-a067-c3ce1c3436e6 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:32.987683 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0455cee9-ad5a-4610-a24e-3524ab7a1f13 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:32.988670 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0455cee9-ad5a-4610-a24e-3524ab7a1f13 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:32.989833 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9c2ac606-49ce-4048-a067-c3ce1c3436e6 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:32.997831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0455cee9-ad5a-4610-a24e-3524ab7a1f13 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:32.998768 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0455cee9-ad5a-4610-a24e-3524ab7a1f13 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:32.998969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9c2ac606-49ce-4048-a067-c3ce1c3436e6 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.179533 Sep 15 07:42:32.999534 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0455cee9-ad5a-4610-a24e-3524ab7a1f13 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:33.000120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 271/529] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:32 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:33.000674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0455cee9-ad5a-4610-a24e-3524ab7a1f13 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:33.001426 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0455cee9-ad5a-4610-a24e-3524ab7a1f13 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:33.002257 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0455cee9-ad5a-4610-a24e-3524ab7a1f13 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:33.027459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=100 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:33.181760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0455cee9-ad5a-4610-a24e-3524ab7a1f13 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:33.197824 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0455cee9-ad5a-4610-a24e-3524ab7a1f13 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1368 microversion: 2.1 time: 0.209127 Sep 15 07:42:33.197824 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 259/530] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:32 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:33.300257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a1ece934-6508-4754-aeaf-1688af0a7727 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:33.301165 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a1ece934-6508-4754-aeaf-1688af0a7727 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:33.306933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:33.309602 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a1ece934-6508-4754-aeaf-1688af0a7727 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:33.310430 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a1ece934-6508-4754-aeaf-1688af0a7727 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:33.311109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a1ece934-6508-4754-aeaf-1688af0a7727 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:33.312000 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a1ece934-6508-4754-aeaf-1688af0a7727 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:33.312618 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a1ece934-6508-4754-aeaf-1688af0a7727 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:33.313305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a1ece934-6508-4754-aeaf-1688af0a7727 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:33.506747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-2710a5ab-1d2a-455a-824c-a9b35075a37e req-c0e585b2-ed84-4ab7-8ee7-487d739534d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87eeeb2-97cd-44c5-901c-1266f6fac4c4", "tag": "4c1b17d0-12bd-4cd9-830b-4557784c3c0f"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:33.519716 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-2710a5ab-1d2a-455a-824c-a9b35075a37e req-c0e585b2-ed84-4ab7-8ee7-487d739534d4 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:33.520527 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-2710a5ab-1d2a-455a-824c-a9b35075a37e req-c0e585b2-ed84-4ab7-8ee7-487d739534d4 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:33.521249 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-2710a5ab-1d2a-455a-824c-a9b35075a37e req-c0e585b2-ed84-4ab7-8ee7-487d739534d4 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:33.535699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-2710a5ab-1d2a-455a-824c-a9b35075a37e req-c0e585b2-ed84-4ab7-8ee7-487d739534d4 service nova] Creating event network-changed:4c1b17d0-12bd-4cd9-830b-4557784c3c0f for instance a87eeeb2-97cd-44c5-901c-1266f6fac4c4 on hv-cinder-82414 Sep 15 07:42:33.542804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-2710a5ab-1d2a-455a-824c-a9b35075a37e req-c0e585b2-ed84-4ab7-8ee7-487d739534d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040053 Sep 15 07:42:33.544425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 260/531] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:33.610984 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a1ece934-6508-4754-aeaf-1688af0a7727 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:33.625045 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a1ece934-6508-4754-aeaf-1688af0a7727 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1319 microversion: 2.1 time: 0.328490 Sep 15 07:42:33.626938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 272/532] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:33 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:34.023381 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ab2dd685-f0b7-4201-ba20-1bfa63fb307e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:34.024831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ab2dd685-f0b7-4201-ba20-1bfa63fb307e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:34.032021 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab2dd685-f0b7-4201-ba20-1bfa63fb307e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:34.035956 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab2dd685-f0b7-4201-ba20-1bfa63fb307e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:34.035956 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab2dd685-f0b7-4201-ba20-1bfa63fb307e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:34.035956 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab2dd685-f0b7-4201-ba20-1bfa63fb307e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:34.035956 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab2dd685-f0b7-4201-ba20-1bfa63fb307e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:34.036295 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab2dd685-f0b7-4201-ba20-1bfa63fb307e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:34.216154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-22524244-a540-428f-99af-c0a6cb77feff tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:34.216958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-22524244-a540-428f-99af-c0a6cb77feff tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:34.225544 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22524244-a540-428f-99af-c0a6cb77feff tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:34.228321 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22524244-a540-428f-99af-c0a6cb77feff tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:34.230057 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22524244-a540-428f-99af-c0a6cb77feff tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:34.233488 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22524244-a540-428f-99af-c0a6cb77feff tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:34.234928 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22524244-a540-428f-99af-c0a6cb77feff tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:34.236609 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-22524244-a540-428f-99af-c0a6cb77feff tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:34.378844 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ab2dd685-f0b7-4201-ba20-1bfa63fb307e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:34.391225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ab2dd685-f0b7-4201-ba20-1bfa63fb307e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.371918 Sep 15 07:42:34.408407 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 261/533] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:34 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:34.450622 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-22524244-a540-428f-99af-c0a6cb77feff tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:34.458966 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-22524244-a540-428f-99af-c0a6cb77feff tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1368 microversion: 2.1 time: 0.247968 Sep 15 07:42:34.460807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 273/534] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:34 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:34.648913 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ce4658a1-4f20-459e-9cb0-857d347393af tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:34.649969 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ce4658a1-4f20-459e-9cb0-857d347393af tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:34.653213 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:34.660503 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce4658a1-4f20-459e-9cb0-857d347393af tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:34.660990 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce4658a1-4f20-459e-9cb0-857d347393af tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:34.661418 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce4658a1-4f20-459e-9cb0-857d347393af tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:34.662211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce4658a1-4f20-459e-9cb0-857d347393af tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:34.662664 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce4658a1-4f20-459e-9cb0-857d347393af tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:34.663150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ce4658a1-4f20-459e-9cb0-857d347393af tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:34.911747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ce4658a1-4f20-459e-9cb0-857d347393af tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:34.935655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ce4658a1-4f20-459e-9cb0-857d347393af tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1319 microversion: 2.1 time: 0.290838 Sep 15 07:42:34.938123 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 262/535] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:34 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:35.422027 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-dd0d7a58-09b6-45ef-96a5-118757cf52cb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:35.422561 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-dd0d7a58-09b6-45ef-96a5-118757cf52cb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:35.429094 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd0d7a58-09b6-45ef-96a5-118757cf52cb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:35.429570 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd0d7a58-09b6-45ef-96a5-118757cf52cb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:35.430032 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd0d7a58-09b6-45ef-96a5-118757cf52cb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:35.430716 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd0d7a58-09b6-45ef-96a5-118757cf52cb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:35.431159 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd0d7a58-09b6-45ef-96a5-118757cf52cb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:35.431577 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dd0d7a58-09b6-45ef-96a5-118757cf52cb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:35.490744 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6f085d7f-4989-4e16-8549-a2df500685f7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:35.491350 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6f085d7f-4989-4e16-8549-a2df500685f7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:35.500533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6f085d7f-4989-4e16-8549-a2df500685f7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:35.501021 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6f085d7f-4989-4e16-8549-a2df500685f7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:35.501453 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6f085d7f-4989-4e16-8549-a2df500685f7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:35.502777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6f085d7f-4989-4e16-8549-a2df500685f7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:35.503225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6f085d7f-4989-4e16-8549-a2df500685f7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:35.503645 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6f085d7f-4989-4e16-8549-a2df500685f7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:35.668783 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-dd0d7a58-09b6-45ef-96a5-118757cf52cb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:35.679994 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-dd0d7a58-09b6-45ef-96a5-118757cf52cb tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1259 microversion: 2.1 time: 0.261361 Sep 15 07:42:35.681566 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 274/536] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:35 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:35.689474 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-94e2c8fb-e93f-4b07-9abb-f994af80d1fe req-a2c0f299-f6c4-4f21-9050-09002874a164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a3489f-c5f3-44d4-93c2-da198e8f06f8", "tag": "5143816a-5379-4a8d-ad85-0a16d1348b1e"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:35.700420 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-94e2c8fb-e93f-4b07-9abb-f994af80d1fe req-a2c0f299-f6c4-4f21-9050-09002874a164 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:35.701139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-94e2c8fb-e93f-4b07-9abb-f994af80d1fe req-a2c0f299-f6c4-4f21-9050-09002874a164 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:35.701717 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-94e2c8fb-e93f-4b07-9abb-f994af80d1fe req-a2c0f299-f6c4-4f21-9050-09002874a164 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:35.714904 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-94e2c8fb-e93f-4b07-9abb-f994af80d1fe req-a2c0f299-f6c4-4f21-9050-09002874a164 service nova] Creating event network-changed:5143816a-5379-4a8d-ad85-0a16d1348b1e for instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 on hv-cinder-82414 Sep 15 07:42:35.720519 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-94e2c8fb-e93f-4b07-9abb-f994af80d1fe req-a2c0f299-f6c4-4f21-9050-09002874a164 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036048 Sep 15 07:42:35.721501 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 275/537] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:35.968580 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d479e546-1c7d-4753-a3a6-4b2dcda6eef8 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:35.969568 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d479e546-1c7d-4753-a3a6-4b2dcda6eef8 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:35.977541 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d479e546-1c7d-4753-a3a6-4b2dcda6eef8 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:35.978060 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d479e546-1c7d-4753-a3a6-4b2dcda6eef8 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:35.978502 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d479e546-1c7d-4753-a3a6-4b2dcda6eef8 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:35.979244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d479e546-1c7d-4753-a3a6-4b2dcda6eef8 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:35.979699 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d479e546-1c7d-4753-a3a6-4b2dcda6eef8 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:35.980896 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d479e546-1c7d-4753-a3a6-4b2dcda6eef8 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:35.998729 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6f085d7f-4989-4e16-8549-a2df500685f7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:36.008280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6f085d7f-4989-4e16-8549-a2df500685f7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1368 microversion: 2.1 time: 0.521177 Sep 15 07:42:36.015123 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 263/538] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:35 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1368 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:36.131676 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d479e546-1c7d-4753-a3a6-4b2dcda6eef8 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:36.140080 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d479e546-1c7d-4753-a3a6-4b2dcda6eef8 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1319 microversion: 2.1 time: 0.176716 Sep 15 07:42:36.140733 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 276/539] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:35 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:36.707789 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-094d37be-b036-4fe7-992e-8b78314f595e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:36.708401 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-094d37be-b036-4fe7-992e-8b78314f595e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:36.710295 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:36.711396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=24 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:36.717654 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-094d37be-b036-4fe7-992e-8b78314f595e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:36.718144 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-094d37be-b036-4fe7-992e-8b78314f595e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:36.718578 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-094d37be-b036-4fe7-992e-8b78314f595e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:36.719275 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-094d37be-b036-4fe7-992e-8b78314f595e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:36.719727 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-094d37be-b036-4fe7-992e-8b78314f595e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:36.720142 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-094d37be-b036-4fe7-992e-8b78314f595e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:36.853832 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-094d37be-b036-4fe7-992e-8b78314f595e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:36.861400 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-094d37be-b036-4fe7-992e-8b78314f595e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1443 microversion: 2.1 time: 0.157435 Sep 15 07:42:36.861992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 264/540] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:36 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:36.884002 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2716b88d-b409-49e1-8ba9-dde72607daee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:36.884610 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2716b88d-b409-49e1-8ba9-dde72607daee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:36.887597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=8 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:36.892311 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2716b88d-b409-49e1-8ba9-dde72607daee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:36.892785 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2716b88d-b409-49e1-8ba9-dde72607daee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:36.902076 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2716b88d-b409-49e1-8ba9-dde72607daee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:36.902076 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2716b88d-b409-49e1-8ba9-dde72607daee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:36.902076 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2716b88d-b409-49e1-8ba9-dde72607daee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:36.902076 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2716b88d-b409-49e1-8ba9-dde72607daee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:37.024109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2716b88d-b409-49e1-8ba9-dde72607daee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:37.032576 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2716b88d-b409-49e1-8ba9-dde72607daee tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1443 microversion: 2.1 time: 0.152408 Sep 15 07:42:37.033143 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 277/541] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:36 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:37.035951 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-28e90b39-0563-458e-8305-229788b8d72f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:37.036557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-28e90b39-0563-458e-8305-229788b8d72f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:37.042349 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28e90b39-0563-458e-8305-229788b8d72f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:37.042822 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28e90b39-0563-458e-8305-229788b8d72f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:37.043246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28e90b39-0563-458e-8305-229788b8d72f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:37.043922 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28e90b39-0563-458e-8305-229788b8d72f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:37.044366 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28e90b39-0563-458e-8305-229788b8d72f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:37.044777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28e90b39-0563-458e-8305-229788b8d72f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:37.163935 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-dfb18d98-9611-4b4c-a81b-2e98c9ae884f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:37.164544 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-dfb18d98-9611-4b4c-a81b-2e98c9ae884f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:37.171832 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb18d98-9611-4b4c-a81b-2e98c9ae884f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:37.172397 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb18d98-9611-4b4c-a81b-2e98c9ae884f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:37.173511 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb18d98-9611-4b4c-a81b-2e98c9ae884f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:37.174364 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb18d98-9611-4b4c-a81b-2e98c9ae884f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:37.175377 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb18d98-9611-4b4c-a81b-2e98c9ae884f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:37.175927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb18d98-9611-4b4c-a81b-2e98c9ae884f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:37.207027 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-28e90b39-0563-458e-8305-229788b8d72f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:37.214794 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-28e90b39-0563-458e-8305-229788b8d72f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1368 microversion: 2.1 time: 0.182689 Sep 15 07:42:37.215391 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 265/542] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:37 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:37.310468 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-dfb18d98-9611-4b4c-a81b-2e98c9ae884f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:37.318245 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-dfb18d98-9611-4b4c-a81b-2e98c9ae884f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1319 microversion: 2.1 time: 0.158434 Sep 15 07:42:37.318837 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 278/543] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:37 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:38.212801 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-9b096343-c560-4801-8ed6-74e92b34f507 req-7a8d6fd7-b866-4015-b5d5-52b3ae14924b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a02c55-496c-4b57-9af0-d40fba32857e", "name": "network-vif-plugged", "status": "completed", "tag": "590166b6-cdd3-443d-ba8a-e41ad7c63879"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:38.223987 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-9b096343-c560-4801-8ed6-74e92b34f507 req-7a8d6fd7-b866-4015-b5d5-52b3ae14924b service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:38.224477 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-9b096343-c560-4801-8ed6-74e92b34f507 req-7a8d6fd7-b866-4015-b5d5-52b3ae14924b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:38.224909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-9b096343-c560-4801-8ed6-74e92b34f507 req-7a8d6fd7-b866-4015-b5d5-52b3ae14924b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:38.236536 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-9b096343-c560-4801-8ed6-74e92b34f507 req-7a8d6fd7-b866-4015-b5d5-52b3ae14924b service nova] Creating event network-vif-plugged:590166b6-cdd3-443d-ba8a-e41ad7c63879 for instance 93a02c55-496c-4b57-9af0-d40fba32857e on hv-cinder-82414 Sep 15 07:42:38.239763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bc69a139-4a03-4be4-9a98-f6b252373309 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:38.239763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bc69a139-4a03-4be4-9a98-f6b252373309 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:38.241820 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-9b096343-c560-4801-8ed6-74e92b34f507 req-7a8d6fd7-b866-4015-b5d5-52b3ae14924b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 Sep 15 07:42:38.242419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 266/544] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:38.246370 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc69a139-4a03-4be4-9a98-f6b252373309 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:38.246864 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc69a139-4a03-4be4-9a98-f6b252373309 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:38.247349 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc69a139-4a03-4be4-9a98-f6b252373309 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:38.248051 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc69a139-4a03-4be4-9a98-f6b252373309 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:38.248512 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc69a139-4a03-4be4-9a98-f6b252373309 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:38.248936 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc69a139-4a03-4be4-9a98-f6b252373309 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:38.344254 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1bebdeb2-3852-4333-abab-163405f9bf77 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:38.345105 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-1bebdeb2-3852-4333-abab-163405f9bf77 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:38.352182 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1bebdeb2-3852-4333-abab-163405f9bf77 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:38.352955 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1bebdeb2-3852-4333-abab-163405f9bf77 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:38.353733 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1bebdeb2-3852-4333-abab-163405f9bf77 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:38.354972 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1bebdeb2-3852-4333-abab-163405f9bf77 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:38.355500 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1bebdeb2-3852-4333-abab-163405f9bf77 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:38.355941 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1bebdeb2-3852-4333-abab-163405f9bf77 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:38.441393 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bc69a139-4a03-4be4-9a98-f6b252373309 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:38.452458 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bc69a139-4a03-4be4-9a98-f6b252373309 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1368 microversion: 2.1 time: 0.218505 Sep 15 07:42:38.453429 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 279/545] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:38 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:38.502423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-1bebdeb2-3852-4333-abab-163405f9bf77 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:38.512199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-1bebdeb2-3852-4333-abab-163405f9bf77 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1319 microversion: 2.1 time: 0.173320 Sep 15 07:42:38.512803 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 267/546] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:38 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:39.215508 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-761c5be2-73cc-4268-9337-9b8cde636b23 req-6f4ce66d-1b0e-43b0-9adf-bc8e71cbe96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d61aa0-bcb6-4fe0-bc26-20ef85c5025e", "tag": "a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:39.225309 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-761c5be2-73cc-4268-9337-9b8cde636b23 req-6f4ce66d-1b0e-43b0-9adf-bc8e71cbe96f service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:39.225817 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-761c5be2-73cc-4268-9337-9b8cde636b23 req-6f4ce66d-1b0e-43b0-9adf-bc8e71cbe96f service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:39.226238 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-761c5be2-73cc-4268-9337-9b8cde636b23 req-6f4ce66d-1b0e-43b0-9adf-bc8e71cbe96f service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:39.237283 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-761c5be2-73cc-4268-9337-9b8cde636b23 req-6f4ce66d-1b0e-43b0-9adf-bc8e71cbe96f service nova] Creating event network-changed:a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14 for instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e on hv-cinder-82414 Sep 15 07:42:39.242711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-761c5be2-73cc-4268-9337-9b8cde636b23 req-6f4ce66d-1b0e-43b0-9adf-bc8e71cbe96f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032289 Sep 15 07:42:39.243482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 280/547] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:39.476136 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-75ac4e69-1543-4f1b-87ba-4ff87b49688d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:39.478782 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-75ac4e69-1543-4f1b-87ba-4ff87b49688d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:39.483932 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75ac4e69-1543-4f1b-87ba-4ff87b49688d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:39.484423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75ac4e69-1543-4f1b-87ba-4ff87b49688d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:39.484866 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75ac4e69-1543-4f1b-87ba-4ff87b49688d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:39.485595 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75ac4e69-1543-4f1b-87ba-4ff87b49688d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:39.486060 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75ac4e69-1543-4f1b-87ba-4ff87b49688d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:39.486488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75ac4e69-1543-4f1b-87ba-4ff87b49688d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:39.540263 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d64d4720-688a-4fb7-92ef-1c443aeb35f4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:39.541383 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d64d4720-688a-4fb7-92ef-1c443aeb35f4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:39.551673 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d64d4720-688a-4fb7-92ef-1c443aeb35f4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:39.552724 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d64d4720-688a-4fb7-92ef-1c443aeb35f4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:39.553662 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d64d4720-688a-4fb7-92ef-1c443aeb35f4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:39.554851 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d64d4720-688a-4fb7-92ef-1c443aeb35f4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:39.555961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d64d4720-688a-4fb7-92ef-1c443aeb35f4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:39.557365 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d64d4720-688a-4fb7-92ef-1c443aeb35f4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:39.693421 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-75ac4e69-1543-4f1b-87ba-4ff87b49688d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:39.705844 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-75ac4e69-1543-4f1b-87ba-4ff87b49688d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1368 microversion: 2.1 time: 0.233515 Sep 15 07:42:39.715267 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 268/548] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:39 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:39.757004 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d64d4720-688a-4fb7-92ef-1c443aeb35f4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:39.766734 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d64d4720-688a-4fb7-92ef-1c443aeb35f4 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1319 microversion: 2.1 time: 0.234352 Sep 15 07:42:39.767421 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 281/549] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:39 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:40.730824 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e0a02889-33cb-45a9-8091-b01710bee7cb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:40.731447 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e0a02889-33cb-45a9-8091-b01710bee7cb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:40.738181 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e0a02889-33cb-45a9-8091-b01710bee7cb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:40.738666 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e0a02889-33cb-45a9-8091-b01710bee7cb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:40.739096 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e0a02889-33cb-45a9-8091-b01710bee7cb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:40.739808 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e0a02889-33cb-45a9-8091-b01710bee7cb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:40.740447 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e0a02889-33cb-45a9-8091-b01710bee7cb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:40.740864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e0a02889-33cb-45a9-8091-b01710bee7cb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:40.789734 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5c229896-681e-45cf-a2cb-e3f54ffdc67b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:40.791689 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5c229896-681e-45cf-a2cb-e3f54ffdc67b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:40.798775 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c229896-681e-45cf-a2cb-e3f54ffdc67b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:40.799593 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c229896-681e-45cf-a2cb-e3f54ffdc67b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:40.800264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c229896-681e-45cf-a2cb-e3f54ffdc67b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:40.801078 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c229896-681e-45cf-a2cb-e3f54ffdc67b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:40.801787 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c229896-681e-45cf-a2cb-e3f54ffdc67b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:40.802416 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c229896-681e-45cf-a2cb-e3f54ffdc67b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:40.951231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e0a02889-33cb-45a9-8091-b01710bee7cb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:40.959777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e0a02889-33cb-45a9-8091-b01710bee7cb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1557 microversion: 2.1 time: 0.233478 Sep 15 07:42:40.960473 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 269/550] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:40 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1557 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:40.987952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3cd9d133-4ff8-496d-b362-dc7465f27fe1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:40.988442 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3cd9d133-4ff8-496d-b362-dc7465f27fe1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:40.994928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cd9d133-4ff8-496d-b362-dc7465f27fe1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:40.995175 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5c229896-681e-45cf-a2cb-e3f54ffdc67b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:40.995409 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cd9d133-4ff8-496d-b362-dc7465f27fe1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:40.995839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cd9d133-4ff8-496d-b362-dc7465f27fe1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:40.996582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cd9d133-4ff8-496d-b362-dc7465f27fe1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:40.997029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cd9d133-4ff8-496d-b362-dc7465f27fe1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:40.997445 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cd9d133-4ff8-496d-b362-dc7465f27fe1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:41.002780 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5c229896-681e-45cf-a2cb-e3f54ffdc67b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1319 microversion: 2.1 time: 0.217043 Sep 15 07:42:41.007152 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 282/551] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:40 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:42:41.074336 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3cd9d133-4ff8-496d-b362-dc7465f27fe1 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090271 Sep 15 07:42:41.074926 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 270/552] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 15 07:42:40 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:42:42.030085 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e6c3c6e9-de3b-4a4e-b08b-eab81ef53ddc tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:42.030917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e6c3c6e9-de3b-4a4e-b08b-eab81ef53ddc tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:42.038195 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6c3c6e9-de3b-4a4e-b08b-eab81ef53ddc tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:42.038684 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6c3c6e9-de3b-4a4e-b08b-eab81ef53ddc tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:42.039265 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6c3c6e9-de3b-4a4e-b08b-eab81ef53ddc tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:42.040657 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6c3c6e9-de3b-4a4e-b08b-eab81ef53ddc tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:42.041689 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6c3c6e9-de3b-4a4e-b08b-eab81ef53ddc tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:42.042120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e6c3c6e9-de3b-4a4e-b08b-eab81ef53ddc tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:42.075297 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-a93ba678-fa3c-4ad5-b3e5-55990770b115 req-f7d004ee-87c9-479f-b8ad-ef052ac40cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a02c55-496c-4b57-9af0-d40fba32857e", "tag": "590166b6-cdd3-443d-ba8a-e41ad7c63879"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:42.085327 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-a93ba678-fa3c-4ad5-b3e5-55990770b115 req-f7d004ee-87c9-479f-b8ad-ef052ac40cd0 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:42.085846 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-a93ba678-fa3c-4ad5-b3e5-55990770b115 req-f7d004ee-87c9-479f-b8ad-ef052ac40cd0 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:42.086280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-a93ba678-fa3c-4ad5-b3e5-55990770b115 req-f7d004ee-87c9-479f-b8ad-ef052ac40cd0 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:42.100628 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-a93ba678-fa3c-4ad5-b3e5-55990770b115 req-f7d004ee-87c9-479f-b8ad-ef052ac40cd0 service nova] Creating event network-changed:590166b6-cdd3-443d-ba8a-e41ad7c63879 for instance 93a02c55-496c-4b57-9af0-d40fba32857e on hv-cinder-82414 Sep 15 07:42:42.107317 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-a93ba678-fa3c-4ad5-b3e5-55990770b115 req-f7d004ee-87c9-479f-b8ad-ef052ac40cd0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035971 Sep 15 07:42:42.108263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 271/553] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:42:42.182298 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e6c3c6e9-de3b-4a4e-b08b-eab81ef53ddc tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:42.190089 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e6c3c6e9-de3b-4a4e-b08b-eab81ef53ddc tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1319 microversion: 2.1 time: 0.165414 Sep 15 07:42:42.190655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 283/554] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:42 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:42.445313 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-9d02ca46-8ba4-4e1e-ad58-c053ed0daac9 req-f4b839c5-cf57-43c0-a116-21269928b81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87eeeb2-97cd-44c5-901c-1266f6fac4c4", "name": "network-vif-plugged", "status": "completed", "tag": "4c1b17d0-12bd-4cd9-830b-4557784c3c0f"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:42.457757 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-9d02ca46-8ba4-4e1e-ad58-c053ed0daac9 req-f4b839c5-cf57-43c0-a116-21269928b81e service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:42.462586 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-9d02ca46-8ba4-4e1e-ad58-c053ed0daac9 req-f4b839c5-cf57-43c0-a116-21269928b81e service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:42.462586 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-9d02ca46-8ba4-4e1e-ad58-c053ed0daac9 req-f4b839c5-cf57-43c0-a116-21269928b81e service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:42.475045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-9d02ca46-8ba4-4e1e-ad58-c053ed0daac9 req-f4b839c5-cf57-43c0-a116-21269928b81e service nova] Creating event network-vif-plugged:4c1b17d0-12bd-4cd9-830b-4557784c3c0f for instance a87eeeb2-97cd-44c5-901c-1266f6fac4c4 on hv-cinder-82414 Sep 15 07:42:42.482685 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-9d02ca46-8ba4-4e1e-ad58-c053ed0daac9 req-f4b839c5-cf57-43c0-a116-21269928b81e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041772 Sep 15 07:42:42.483765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 272/555] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:42:43.212888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-dded2ae7-a320-48e7-a82f-76ea84c80725 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:43.214084 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-dded2ae7-a320-48e7-a82f-76ea84c80725 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:43.220790 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dded2ae7-a320-48e7-a82f-76ea84c80725 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:43.221283 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dded2ae7-a320-48e7-a82f-76ea84c80725 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:43.221795 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dded2ae7-a320-48e7-a82f-76ea84c80725 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:43.222502 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dded2ae7-a320-48e7-a82f-76ea84c80725 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:43.222962 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dded2ae7-a320-48e7-a82f-76ea84c80725 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:43.223390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dded2ae7-a320-48e7-a82f-76ea84c80725 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:43.362418 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-dded2ae7-a320-48e7-a82f-76ea84c80725 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:43.370841 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-dded2ae7-a320-48e7-a82f-76ea84c80725 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1319 microversion: 2.1 time: 0.162361 Sep 15 07:42:43.371426 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 284/556] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:43 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:44.394446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1855ceaf-2fd3-4cb8-93f1-1037a88b393b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:44.395134 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-1855ceaf-2fd3-4cb8-93f1-1037a88b393b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:44.402091 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1855ceaf-2fd3-4cb8-93f1-1037a88b393b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:44.402563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1855ceaf-2fd3-4cb8-93f1-1037a88b393b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:44.402989 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1855ceaf-2fd3-4cb8-93f1-1037a88b393b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:44.403666 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1855ceaf-2fd3-4cb8-93f1-1037a88b393b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:44.404115 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1855ceaf-2fd3-4cb8-93f1-1037a88b393b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:44.404527 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1855ceaf-2fd3-4cb8-93f1-1037a88b393b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:44.533536 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-1855ceaf-2fd3-4cb8-93f1-1037a88b393b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:44.541917 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-1855ceaf-2fd3-4cb8-93f1-1037a88b393b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1319 microversion: 2.1 time: 0.151579 Sep 15 07:42:44.542478 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 273/557] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:44 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:45.564295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4dddc7b7-e17c-4fb0-92c2-353db7a077a0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:45.564817 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-4dddc7b7-e17c-4fb0-92c2-353db7a077a0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:45.572757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4dddc7b7-e17c-4fb0-92c2-353db7a077a0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:45.573295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4dddc7b7-e17c-4fb0-92c2-353db7a077a0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:45.573764 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4dddc7b7-e17c-4fb0-92c2-353db7a077a0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:45.574474 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4dddc7b7-e17c-4fb0-92c2-353db7a077a0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:45.574927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4dddc7b7-e17c-4fb0-92c2-353db7a077a0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:45.583283 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4dddc7b7-e17c-4fb0-92c2-353db7a077a0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:45.711098 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4dddc7b7-e17c-4fb0-92c2-353db7a077a0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:45.723534 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4dddc7b7-e17c-4fb0-92c2-353db7a077a0 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1509 microversion: 2.1 time: 0.160041 Sep 15 07:42:45.723534 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 285/558] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:42:45 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:45.746298 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5aae52b1-0774-45f9-814c-fb6ea1030b56 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78769b91-1c23-4108-835a-351f2d0318df", "device": "/dev/sdb"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:42:45.749164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5aae52b1-0774-45f9-814c-fb6ea1030b56 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:45.755642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5aae52b1-0774-45f9-814c-fb6ea1030b56 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:45.756131 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5aae52b1-0774-45f9-814c-fb6ea1030b56 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:45.756570 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5aae52b1-0774-45f9-814c-fb6ea1030b56 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:45.757277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5aae52b1-0774-45f9-814c-fb6ea1030b56 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:45.757978 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5aae52b1-0774-45f9-814c-fb6ea1030b56 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:45.758434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5aae52b1-0774-45f9-814c-fb6ea1030b56 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:46.498212 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5aae52b1-0774-45f9-814c-fb6ea1030b56 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "POST /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756387 Sep 15 07:42:46.498855 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 274/559] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:42:45 2022] POST /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:42:53.607584 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7b4e6750-004e-4919-a643-a84218c4ed9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:53.608134 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7b4e6750-004e-4919-a643-a84218c4ed9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:53.614500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b4e6750-004e-4919-a643-a84218c4ed9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:53.614981 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b4e6750-004e-4919-a643-a84218c4ed9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:53.615415 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b4e6750-004e-4919-a643-a84218c4ed9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:53.616096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b4e6750-004e-4919-a643-a84218c4ed9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:53.616545 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b4e6750-004e-4919-a643-a84218c4ed9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:53.616965 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7b4e6750-004e-4919-a643-a84218c4ed9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:53.644751 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7b4e6750-004e-4919-a643-a84218c4ed9b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments/02ac7681-a783-427b-8d56-4462630a3794" status: 200 len: 194 microversion: 2.20 time: 0.041133 Sep 15 07:42:53.645887 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 286/560] 10.222.0.42 () {60 vars in 1454 bytes} [Thu Sep 15 07:42:53 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments/02ac7681-a783-427b-8d56-4462630a3794 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:42:53.715591 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7e7017eb-546e-4dbf-a771-474a90f2d757 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:53.716171 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7e7017eb-546e-4dbf-a771-474a90f2d757 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:53.722351 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7e7017eb-546e-4dbf-a771-474a90f2d757 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:53.722829 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7e7017eb-546e-4dbf-a771-474a90f2d757 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:53.723908 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7e7017eb-546e-4dbf-a771-474a90f2d757 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:53.724593 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7e7017eb-546e-4dbf-a771-474a90f2d757 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:53.725040 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7e7017eb-546e-4dbf-a771-474a90f2d757 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:53.725456 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7e7017eb-546e-4dbf-a771-474a90f2d757 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:53.808021 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-7e7017eb-546e-4dbf-a771-474a90f2d757 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lazy-loading 'services' on Instance uuid 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:42:54.016172 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7e7017eb-546e-4dbf-a771-474a90f2d757 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "DELETE /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments/02ac7681-a783-427b-8d56-4462630a3794" status: 202 len: 0 microversion: 2.20 time: 0.305508 Sep 15 07:42:54.016692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 275/561] 10.222.0.42 () {60 vars in 1457 bytes} [Thu Sep 15 07:42:53 2022] DELETE /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments/02ac7681-a783-427b-8d56-4462630a3794 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:42:54.026233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f3a34e2d-d390-4646-b856-ff9ccb1b5a34 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:54.028472 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f3a34e2d-d390-4646-b856-ff9ccb1b5a34 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:54.034521 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3a34e2d-d390-4646-b856-ff9ccb1b5a34 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:54.035069 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3a34e2d-d390-4646-b856-ff9ccb1b5a34 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:54.035687 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3a34e2d-d390-4646-b856-ff9ccb1b5a34 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:54.036367 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3a34e2d-d390-4646-b856-ff9ccb1b5a34 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:54.036824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3a34e2d-d390-4646-b856-ff9ccb1b5a34 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:54.037252 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3a34e2d-d390-4646-b856-ff9ccb1b5a34 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:54.067214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f3a34e2d-d390-4646-b856-ff9ccb1b5a34 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044836 Sep 15 07:42:54.068102 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 287/562] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 15 07:42:54 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:42:55.080813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-89ac8fc5-e2b9-4758-98c3-2a37b1b7f6b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:55.086284 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-89ac8fc5-e2b9-4758-98c3-2a37b1b7f6b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:55.090449 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-89ac8fc5-e2b9-4758-98c3-2a37b1b7f6b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:55.090928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-89ac8fc5-e2b9-4758-98c3-2a37b1b7f6b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:55.091356 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-89ac8fc5-e2b9-4758-98c3-2a37b1b7f6b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:55.092044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-89ac8fc5-e2b9-4758-98c3-2a37b1b7f6b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:55.092496 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-89ac8fc5-e2b9-4758-98c3-2a37b1b7f6b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:55.092993 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-89ac8fc5-e2b9-4758-98c3-2a37b1b7f6b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:55.123236 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-89ac8fc5-e2b9-4758-98c3-2a37b1b7f6b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046802 Sep 15 07:42:55.123811 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 276/563] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 15 07:42:55 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:42:56.135975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-eec4ae66-a8b5-4135-b351-7594d0431f74 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:56.138297 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-eec4ae66-a8b5-4135-b351-7594d0431f74 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:56.140719 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=74 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:56.146292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eec4ae66-a8b5-4135-b351-7594d0431f74 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:56.146778 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eec4ae66-a8b5-4135-b351-7594d0431f74 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:56.147264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eec4ae66-a8b5-4135-b351-7594d0431f74 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:56.148239 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eec4ae66-a8b5-4135-b351-7594d0431f74 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:56.148696 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eec4ae66-a8b5-4135-b351-7594d0431f74 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:56.149119 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-eec4ae66-a8b5-4135-b351-7594d0431f74 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:56.165777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:56.178761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-eec4ae66-a8b5-4135-b351-7594d0431f74 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046813 Sep 15 07:42:56.180000 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 288/564] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 15 07:42:56 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:42:56.244823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-12772d6a-758d-4b64-8179-bde00fe4bc65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:56.245319 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-12772d6a-758d-4b64-8179-bde00fe4bc65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:56.251661 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12772d6a-758d-4b64-8179-bde00fe4bc65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:56.252135 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12772d6a-758d-4b64-8179-bde00fe4bc65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:56.252562 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12772d6a-758d-4b64-8179-bde00fe4bc65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:56.253236 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12772d6a-758d-4b64-8179-bde00fe4bc65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:56.254336 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12772d6a-758d-4b64-8179-bde00fe4bc65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:56.254750 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12772d6a-758d-4b64-8179-bde00fe4bc65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:56.258839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:42:56.283682 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-12772d6a-758d-4b64-8179-bde00fe4bc65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Going to try to terminate instance {{(pid=132673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:42:56.570436 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-12772d6a-758d-4b64-8179-bde00fe4bc65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "DELETE /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 204 len: 0 microversion: 2.20 time: 0.329111 Sep 15 07:42:56.571061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 277/565] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 15 07:42:56 2022] DELETE /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 07:42:56.579261 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:56.579870 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:56.586203 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:56.587550 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:56.587550 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:56.587783 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:56.588191 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:56.588612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:56.730611 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:56.739954 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:56.741400 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:56.742613 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4c78abda-75dd-4c20-abef-89005ed9e5d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.167296 Sep 15 07:42:56.743166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 289/566] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:42:56 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:42:57.771312 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:57.772283 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:57.778639 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:57.779114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:57.779549 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:57.780229 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:57.780674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:57.781091 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:57.912500 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:57.920404 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:57.921881 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:57.923029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-fb74cc61-bf21-4718-be88-0ce254e6b877 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.156197 Sep 15 07:42:57.923583 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 278/567] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:42:57 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:42:58.949340 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:42:58.949985 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:42:58.956033 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:58.956515 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:58.956944 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:58.957657 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:42:58.958107 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:42:58.958524 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:42:59.091084 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:59.099773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:59.101199 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:42:59.102414 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d8734838-ca33-449e-8407-96371f1749d7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.157626 Sep 15 07:42:59.102955 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 290/568] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:42:58 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:00.128745 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:00.129426 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:00.135984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:00.136458 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:00.136882 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:00.137564 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:00.138042 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:00.138458 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:00.263775 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:00.273079 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:00.274550 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:00.275715 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d0afc92b-c2ac-4c42-b16d-bbaa6ba74130 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.151955 Sep 15 07:43:00.276278 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 279/569] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:00 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:01.300410 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:01.301019 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:01.307636 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:01.308112 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:01.308546 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:01.309227 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:01.309704 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:01.310128 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:01.440192 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:01.448342 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:01.449845 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:01.451005 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c828817b-33e1-4f41-96c0-c16fd6af362d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.154672 Sep 15 07:43:01.451569 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 291/570] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:01 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:02.476723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:02.482511 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:02.483988 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:02.484470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:02.484903 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:02.485646 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:02.486099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:02.486525 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:02.623269 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:02.632254 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:02.633723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:02.634872 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b18ffe37-071c-456f-9b3f-f7adbfa607af tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.162183 Sep 15 07:43:02.635427 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 280/571] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:02 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:03.660408 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:03.661043 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:03.668088 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:03.668666 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:03.669115 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:03.669870 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:03.670492 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:03.670927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:03.805876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:03.817641 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:03.822010 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:03.823278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-aad6d515-acd6-42f6-8899-717da3b98390 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1723 microversion: 2.20 time: 0.166829 Sep 15 07:43:03.823848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 292/572] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:03 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:04.549958 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-47c7a09a-d0b6-44b4-a009-ce5b2d4886a1 req-41dc5bb8-3e9c-490d-94f7-0bfb331847e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ae2103-9abb-45d7-94b1-7e0f83c44fa0", "name": "network-vif-deleted", "tag": "60114f49-493e-46b0-a653-b05d4362ebe7"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:04.560032 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-47c7a09a-d0b6-44b4-a009-ce5b2d4886a1 req-41dc5bb8-3e9c-490d-94f7-0bfb331847e3 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:04.568754 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-47c7a09a-d0b6-44b4-a009-ce5b2d4886a1 req-41dc5bb8-3e9c-490d-94f7-0bfb331847e3 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:04.568754 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-47c7a09a-d0b6-44b4-a009-ce5b2d4886a1 req-41dc5bb8-3e9c-490d-94f7-0bfb331847e3 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:04.572832 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-47c7a09a-d0b6-44b4-a009-ce5b2d4886a1 req-41dc5bb8-3e9c-490d-94f7-0bfb331847e3 service nova] Creating event network-vif-deleted:60114f49-493e-46b0-a653-b05d4362ebe7 for instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 on hv-cinder-82414 Sep 15 07:43:04.577904 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-47c7a09a-d0b6-44b4-a009-ce5b2d4886a1 req-41dc5bb8-3e9c-490d-94f7-0bfb331847e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032113 Sep 15 07:43:04.578509 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 281/573] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:43:04.850240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:04.850852 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:04.857788 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:04.858570 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:04.859142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:04.860789 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:04.861447 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:04.862060 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:04.895994 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:04.896473 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:04.896909 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:04.897378 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lazy-loading 'fault' on Instance uuid 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:43:04.961941 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:04.970573 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:04.972139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:04.973387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3c25f21c-c683-432f-9cfa-c670296f879d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 200 len: 1371 microversion: 2.20 time: 0.127169 Sep 15 07:43:04.974046 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 293/574] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:04 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:05.999874 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:06.000570 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:06.002778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:06.007577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:06.012551 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:06.012551 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:06.012551 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:06.012551 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:06.012947 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:06.024765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] HTTP exception thrown: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Request method failure captured: Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 HTTP/1.1 Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaHrqBR6jSRpxwpKo9b0BSB0acQf1s18cMemrxh_psM8wYgLWn0tT0A0_Tzcowhkz5_TsC4P50hY7avW225VRdj8qMfj6Ngk5xRLN7x2r4HYn1iIRCXiGkc4-u37AFRJ_46JPo9zOrQ_Flnu5DrBRNBarwnDuSx_c5UOoc5qYbkvvY Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:43:06.026472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4a8f2664964492e9c80a595ed043c71"}]}] Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 56c2f854cf074b1ba2571766b7f2fc51 Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:43:06.028224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '07ae2103-9abb-45d7-94b1-7e0f83c44fa0'} Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:43:06.029371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:43:06.030925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:06.032901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Returning 404 to user: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:43:06.032901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ac25bd57-8325-4955-aad8-62692df13310 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 404 len: 111 microversion: 2.20 time: 0.032717 Sep 15 07:43:06.032901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 282/575] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:05 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 07:43:06.037339 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ec307b64-3aae-4070-8858-2030615df5ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '.version_select at 0x7ff36c96c8b0>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:06.087093 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ec307b64-3aae-4070-8858-2030615df5ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-331169569" status: 204 len: 0 microversion: 2.20 time: 0.053561 Sep 15 07:43:06.087646 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 294/576] 10.222.0.42 () {60 vars in 1259 bytes} [Thu Sep 15 07:43:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-331169569 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 15 07:43:06.840523 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-202866e3-d14b-4ded-830a-3ec58c8fccf8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Action: 'create', calling method: .version_select at 0x7ff36c98c4c0>, body: {"keypair": {"name": "tempest-keypair-987283050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3IBYG4j3NCdgL1nPKk9gsTVRfil8Vbc8k7s0SCHm1Wj0dAsPVs7qcDRk2NMqbQ06SiHLQIesGC2otUYkPmLbVWdTgfAp5IWjG/dJorXcYgXdWX/MuTnv5dlFkrNVTseg=="}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:06.856699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-202866e3-d14b-4ded-830a-3ec58c8fccf8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Getting quotas for project b4a8f2664964492e9c80a595ed043c71. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:43:06.860703 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-202866e3-d14b-4ded-830a-3ec58c8fccf8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Getting quotas for user 56c2f854cf074b1ba2571766b7f2fc51 and project b4a8f2664964492e9c80a595ed043c71. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:43:06.933526 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-202866e3-d14b-4ded-830a-3ec58c8fccf8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.096993 Sep 15 07:43:06.934184 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 283/577] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Sep 15 07:43:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 15 07:43:07.561079 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-44b356e0-ad0e-4a79-8ee3-07dadf85ba39 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:07.561549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-44b356e0-ad0e-4a79-8ee3-07dadf85ba39 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:07.568587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-44b356e0-ad0e-4a79-8ee3-07dadf85ba39 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:07.569065 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-44b356e0-ad0e-4a79-8ee3-07dadf85ba39 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:07.569498 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-44b356e0-ad0e-4a79-8ee3-07dadf85ba39 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:07.570205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-44b356e0-ad0e-4a79-8ee3-07dadf85ba39 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:07.570655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-44b356e0-ad0e-4a79-8ee3-07dadf85ba39 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:07.571075 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-44b356e0-ad0e-4a79-8ee3-07dadf85ba39 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:07.652856 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-44b356e0-ad0e-4a79-8ee3-07dadf85ba39 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lazy-loading 'services' on Instance uuid a87eeeb2-97cd-44c5-901c-1266f6fac4c4 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:43:07.879590 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-44b356e0-ad0e-4a79-8ee3-07dadf85ba39 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4/os-volume_attachments/78769b91-1c23-4108-835a-351f2d0318df" status: 202 len: 0 microversion: 2.1 time: 0.322168 Sep 15 07:43:07.880111 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 295/578] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:43:07 2022] DELETE /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4/os-volume_attachments/78769b91-1c23-4108-835a-351f2d0318df => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:43:09.094984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-991853453", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b6b3bac-c651-487a-b144-89fba4985d6c"}], "security_groups": [{"name": "tempest-securitygroup--1446560867"}], "key_name": "tempest-keypair-987283050", "user_data": "}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:09.198192 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] validate_networks() for [('2b6b3bac-c651-487a-b144-89fba4985d6c', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:43:09.568733 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:43:09.569156 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:43:09.569656 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:43:09.574986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:43:09.574986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:43:09.580277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:09.580761 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:09.581201 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:09.581987 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:09.582443 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:09.582868 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:09.600647 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Getting quotas for project b4a8f2664964492e9c80a595ed043c71. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:43:09.604593 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Getting quotas for user 56c2f854cf074b1ba2571766b7f2fc51 and project b4a8f2664964492e9c80a595ed043c71. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:43:09.615730 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:43:09.618066 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:43:09.711108 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-94833b92-ab2a-4370-a8bf-efc7b6ae88b8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.621217 Sep 15 07:43:09.711833 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 284/579] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Sep 15 07:43:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 07:43:09.724180 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b5cb1b90-a57a-48c3-9e13-5d4fb03ca1bd tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:09.724874 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b5cb1b90-a57a-48c3-9e13-5d4fb03ca1bd tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:09.779115 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b5cb1b90-a57a-48c3-9e13-5d4fb03ca1bd tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:09.786479 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b5cb1b90-a57a-48c3-9e13-5d4fb03ca1bd tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:09.787915 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b5cb1b90-a57a-48c3-9e13-5d4fb03ca1bd tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:09.789014 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b5cb1b90-a57a-48c3-9e13-5d4fb03ca1bd tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1280 microversion: 2.20 time: 0.069631 Sep 15 07:43:09.789560 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 296/580] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:09 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:10.069213 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b634d01a-83fd-4ab3-8624-2336852bda5f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:10.069715 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b634d01a-83fd-4ab3-8624-2336852bda5f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:10.075909 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b634d01a-83fd-4ab3-8624-2336852bda5f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:10.076388 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b634d01a-83fd-4ab3-8624-2336852bda5f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:10.076853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b634d01a-83fd-4ab3-8624-2336852bda5f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:10.077539 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b634d01a-83fd-4ab3-8624-2336852bda5f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:10.078730 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b634d01a-83fd-4ab3-8624-2336852bda5f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:10.079350 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b634d01a-83fd-4ab3-8624-2336852bda5f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:10.105328 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b634d01a-83fd-4ab3-8624-2336852bda5f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Going to try to terminate instance {{(pid=132673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:43:10.359937 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b634d01a-83fd-4ab3-8624-2336852bda5f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 204 len: 0 microversion: 2.1 time: 0.294395 Sep 15 07:43:10.360662 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 285/581] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:43:10 2022] DELETE /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:43:10.368984 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-8f328b87-84c8-4e1a-9e18-d7cc3f68f29b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:10.369629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-8f328b87-84c8-4e1a-9e18-d7cc3f68f29b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:10.377018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f328b87-84c8-4e1a-9e18-d7cc3f68f29b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:10.377501 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f328b87-84c8-4e1a-9e18-d7cc3f68f29b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:10.377971 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f328b87-84c8-4e1a-9e18-d7cc3f68f29b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:10.378709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f328b87-84c8-4e1a-9e18-d7cc3f68f29b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:10.379203 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f328b87-84c8-4e1a-9e18-d7cc3f68f29b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:10.379638 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f328b87-84c8-4e1a-9e18-d7cc3f68f29b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:10.513280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8f328b87-84c8-4e1a-9e18-d7cc3f68f29b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:10.522146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-8f328b87-84c8-4e1a-9e18-d7cc3f68f29b tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1515 microversion: 2.1 time: 0.157058 Sep 15 07:43:10.522718 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 297/582] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:10 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:10.814717 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:10.815419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:10.821305 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:10.821826 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:10.822266 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:10.822957 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:10.823413 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:10.823836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:10.884858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:10.893426 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:10.894914 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:10.896043 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d1f23854-5d96-4854-9808-1a4237d2b59e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1284 microversion: 2.20 time: 0.086323 Sep 15 07:43:10.896602 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 286/583] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:10 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:43:11.544346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0eb4508d-9369-4481-bd19-3c6991dbf87f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:11.544965 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0eb4508d-9369-4481-bd19-3c6991dbf87f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:11.551960 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0eb4508d-9369-4481-bd19-3c6991dbf87f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:11.552441 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0eb4508d-9369-4481-bd19-3c6991dbf87f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:11.552877 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0eb4508d-9369-4481-bd19-3c6991dbf87f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:11.553568 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0eb4508d-9369-4481-bd19-3c6991dbf87f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:11.554054 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0eb4508d-9369-4481-bd19-3c6991dbf87f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:11.554479 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0eb4508d-9369-4481-bd19-3c6991dbf87f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:11.691593 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0eb4508d-9369-4481-bd19-3c6991dbf87f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:11.699430 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0eb4508d-9369-4481-bd19-3c6991dbf87f tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1515 microversion: 2.1 time: 0.158842 Sep 15 07:43:11.699999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 298/584] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:11 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:11.920486 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:11.921035 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:11.928092 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:11.928596 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:11.929029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:11.929751 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:11.930202 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:11.930618 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:11.992339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:12.000349 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:12.001806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:12.002902 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-142047d0-9274-4f2f-a05d-2217c61af3bc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1284 microversion: 2.20 time: 0.086407 Sep 15 07:43:12.003461 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 287/585] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:11 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:12.725957 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5c1c7957-f4c1-4e71-8327-015176e04ff3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:12.726667 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5c1c7957-f4c1-4e71-8327-015176e04ff3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:12.733434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c1c7957-f4c1-4e71-8327-015176e04ff3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:12.734008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c1c7957-f4c1-4e71-8327-015176e04ff3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:12.735208 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c1c7957-f4c1-4e71-8327-015176e04ff3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:12.736254 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c1c7957-f4c1-4e71-8327-015176e04ff3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:12.736774 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c1c7957-f4c1-4e71-8327-015176e04ff3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:12.737280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5c1c7957-f4c1-4e71-8327-015176e04ff3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:12.870429 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5c1c7957-f4c1-4e71-8327-015176e04ff3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:12.879244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5c1c7957-f4c1-4e71-8327-015176e04ff3 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1515 microversion: 2.1 time: 0.157124 Sep 15 07:43:12.879810 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 299/586] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:12 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:13.027345 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:13.028000 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:13.036358 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:13.040800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:13.040800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:13.040800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:13.040800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:13.041344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:13.105113 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:13.114818 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:13.116821 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:13.118254 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d22e92ad-a8fe-4b95-8ace-1172431f0784 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1332 microversion: 2.20 time: 0.094778 Sep 15 07:43:13.125622 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 288/587] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:13 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:13.200308 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-4238216a-d633-43d5-97d0-8aed9a56a7e4 req-79ad53a4-18d6-4157-91a2-2241610d397a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87eeeb2-97cd-44c5-901c-1266f6fac4c4", "name": "network-vif-deleted", "tag": "4c1b17d0-12bd-4cd9-830b-4557784c3c0f"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:13.210603 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4238216a-d633-43d5-97d0-8aed9a56a7e4 req-79ad53a4-18d6-4157-91a2-2241610d397a service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:13.211092 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4238216a-d633-43d5-97d0-8aed9a56a7e4 req-79ad53a4-18d6-4157-91a2-2241610d397a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:13.211557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4238216a-d633-43d5-97d0-8aed9a56a7e4 req-79ad53a4-18d6-4157-91a2-2241610d397a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:13.224118 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-4238216a-d633-43d5-97d0-8aed9a56a7e4 req-79ad53a4-18d6-4157-91a2-2241610d397a service nova] Creating event network-vif-deleted:4c1b17d0-12bd-4cd9-830b-4557784c3c0f for instance a87eeeb2-97cd-44c5-901c-1266f6fac4c4 on hv-cinder-82414 Sep 15 07:43:13.229262 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-4238216a-d633-43d5-97d0-8aed9a56a7e4 req-79ad53a4-18d6-4157-91a2-2241610d397a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033866 Sep 15 07:43:13.229969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 300/588] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:43:13.902448 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:13.903192 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:13.912965 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:13.913470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:13.915700 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:13.916161 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:13.916635 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:13.917221 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:13.966813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:13.967334 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:13.967760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:13.968210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lazy-loading 'fault' on Instance uuid a87eeeb2-97cd-44c5-901c-1266f6fac4c4 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:43:14.019295 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7e3a9a28134a28a3f8f30d4b0fcb8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cb9c7c7eb24e30bf89b3680c713472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:14.035643 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-53999653-9455-4f53-82e6-92f2b1f29c54 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 200 len: 1309 microversion: 2.1 time: 0.134106 Sep 15 07:43:14.036817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 289/589] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:13 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 1309 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:14.151767 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:14.152543 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:14.160061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:14.161121 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:14.161686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:14.162692 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:14.163308 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:14.163804 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:14.238305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:14.246688 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:14.248215 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:14.249424 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fe026aee-bc0d-4c1b-ad7b-0dae524b059b tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1338 microversion: 2.20 time: 0.104269 Sep 15 07:43:14.250534 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 301/590] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:14 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:15.059038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:15.059708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] [instance: a87eeeb2-97cd-44c5-901c-1266f6fac4c4] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:15.066268 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:15.066976 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:15.067422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:15.068120 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:15.068576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:15.069001 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:15.082699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] HTTP exception thrown: Instance a87eeeb2-97cd-44c5-901c-1266f6fac4c4 could not be found. Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Request method failure captured: Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 HTTP/1.1 Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItcDZLwGA2NfZ3QB6YdfdruhKepNTCgFAsq-mtCtT_4HVNQ54daN30fASP0NBFlqC4fq-QBoNX2gMk7SQgrV0TeD9bqUpweuODCjey1Me8U6IXWJlKK7ZIvcoqsWyRTk0pMl-BLIDKfiUCmoc17JCL7DForijQNfT1YP28m1z9SnbDM Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 66cb9c7c7eb24e30bf89b3680c713472 Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-VolumesSnapshotTestJSON-172324038 Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:43:15.084333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_66cb9c7c7eb24e30bf89b3680c713472"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66cb9c7c7eb24e30bf89b3680c713472"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/66cb9c7c7eb24e30bf89b3680c713472"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/66cb9c7c7eb24e30bf89b3680c713472"}]}] Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-VolumesSnapshotTestJSON-172324038 Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 66cb9c7c7eb24e30bf89b3680c713472 Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-172324038 Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-VolumesSnapshotTestJSON-172324038-project Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: ae7e3a9a28134a28a3f8f30d4b0fcb8c Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-VolumesSnapshotTestJSON-172324038-project Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance a87eeeb2-97cd-44c5-901c-1266f6fac4c4 could not be found. Sep 15 07:43:15.085901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': 'a87eeeb2-97cd-44c5-901c-1266f6fac4c4'} Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87eeeb2-97cd-44c5-901c-1266f6fac4c4 could not be found. Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:43:15.089760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87eeeb2-97cd-44c5-901c-1266f6fac4c4 could not be found. Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87eeeb2-97cd-44c5-901c-1266f6fac4c4 could not be found. Sep 15 07:43:15.091114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:15.092320 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] Returning 404 to user: Instance a87eeeb2-97cd-44c5-901c-1266f6fac4c4 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:43:15.092320 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-1f34aa0c-9191-492c-9aa2-f3c9be734938 tempest-VolumesSnapshotTestJSON-172324038 tempest-VolumesSnapshotTestJSON-172324038-project] 10.222.0.42 "GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4" status: 404 len: 111 microversion: 2.1 time: 0.030576 Sep 15 07:43:15.092320 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 290/591] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:15 2022] GET /compute/v2.1/servers/a87eeeb2-97cd-44c5-901c-1266f6fac4c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:43:15.279342 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:15.279972 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:15.287998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:15.288483 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:15.288918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:15.289642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:15.290113 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:15.290517 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:15.446822 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:15.455526 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:15.456953 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:15.458084 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-889ee2d3-6665-441d-91e2-414c99ca39e1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1406 microversion: 2.20 time: 0.182727 Sep 15 07:43:15.463830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 302/592] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:15 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:15.655460 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-3a47001e-1dd2-4657-936c-ab5916ab2af6 req-f36dba93-d804-49c7-8aee-f32a91bbcb40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f14c845-5f86-4d74-8813-e7c482a6be08", "tag": "2f98d201-6410-4508-a7f3-40ecd7daed4f"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:15.668756 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-3a47001e-1dd2-4657-936c-ab5916ab2af6 req-f36dba93-d804-49c7-8aee-f32a91bbcb40 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:15.669322 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-3a47001e-1dd2-4657-936c-ab5916ab2af6 req-f36dba93-d804-49c7-8aee-f32a91bbcb40 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:15.669860 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-3a47001e-1dd2-4657-936c-ab5916ab2af6 req-f36dba93-d804-49c7-8aee-f32a91bbcb40 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:15.681858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-3a47001e-1dd2-4657-936c-ab5916ab2af6 req-f36dba93-d804-49c7-8aee-f32a91bbcb40 service nova] Creating event network-changed:2f98d201-6410-4508-a7f3-40ecd7daed4f for instance 0f14c845-5f86-4d74-8813-e7c482a6be08 on hv-cinder-82414 Sep 15 07:43:15.690278 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-3a47001e-1dd2-4657-936c-ab5916ab2af6 req-f36dba93-d804-49c7-8aee-f32a91bbcb40 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040060 Sep 15 07:43:15.690278 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 291/593] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:43:16.484535 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:16.485069 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:16.491815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:16.492305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:16.492753 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:16.493461 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:16.493982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:16.494411 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:16.629978 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:16.638310 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:16.639974 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:16.641591 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7d4066ea-f282-41e2-ad01-a4dbd4a8dcd1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1406 microversion: 2.20 time: 0.161491 Sep 15 07:43:16.642175 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 303/594] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:16 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:17.668011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:17.668692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:17.675720 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:17.676195 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:17.676627 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:17.677304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:17.677787 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:17.678289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:17.805631 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:17.814506 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:17.815954 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:17.817073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-832da102-d152-4ed9-886d-4a8d2bca78f0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1406 microversion: 2.20 time: 0.153912 Sep 15 07:43:17.817650 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 292/595] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:17 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:18.841779 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:18.842714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:18.849121 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:18.849632 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:18.850079 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:18.850766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:18.851217 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:18.851639 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:18.980377 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:18.989077 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:18.990529 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:18.991626 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b99cbcb9-9382-4975-8290-d479c81e12b6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1406 microversion: 2.20 time: 0.153787 Sep 15 07:43:18.992179 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 304/596] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:18 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:20.017269 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:20.017818 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:20.020161 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:20.020972 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=10 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:20.025476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:20.025985 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:20.026462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:20.027141 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:20.027584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:20.027999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:20.388887 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:20.397212 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:20.398703 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:20.399815 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-44a9ee86-3536-4fb3-a0fd-ce399cac94ad tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1406 microversion: 2.20 time: 0.387475 Sep 15 07:43:20.400398 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 293/597] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:20 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1406 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:21.426186 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:21.426883 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:21.428875 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:21.434061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:21.439119 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:21.439119 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:21.439119 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:21.439119 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:21.439480 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:21.564474 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:21.572409 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:21.573888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:21.575006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5d8e0d31-4298-47d2-a6ee-05c7c3c4a272 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1406 microversion: 2.20 time: 0.152700 Sep 15 07:43:21.575778 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 305/598] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:21 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:22.369289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-4564ee8d-f6af-4bbd-8686-01f6bbb54c7e req-37eac7cf-7f7c-46e8-943e-ac174ea7d0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f14c845-5f86-4d74-8813-e7c482a6be08", "name": "network-vif-plugged", "status": "completed", "tag": "2f98d201-6410-4508-a7f3-40ecd7daed4f"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:22.379358 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-4564ee8d-f6af-4bbd-8686-01f6bbb54c7e req-37eac7cf-7f7c-46e8-943e-ac174ea7d0e9 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:22.379825 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-4564ee8d-f6af-4bbd-8686-01f6bbb54c7e req-37eac7cf-7f7c-46e8-943e-ac174ea7d0e9 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:22.380243 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-4564ee8d-f6af-4bbd-8686-01f6bbb54c7e req-37eac7cf-7f7c-46e8-943e-ac174ea7d0e9 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:22.391936 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-4564ee8d-f6af-4bbd-8686-01f6bbb54c7e req-37eac7cf-7f7c-46e8-943e-ac174ea7d0e9 service nova] Creating event network-vif-plugged:2f98d201-6410-4508-a7f3-40ecd7daed4f for instance 0f14c845-5f86-4d74-8813-e7c482a6be08 on hv-cinder-82414 Sep 15 07:43:22.396871 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-4564ee8d-f6af-4bbd-8686-01f6bbb54c7e req-37eac7cf-7f7c-46e8-943e-ac174ea7d0e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031058 Sep 15 07:43:22.397526 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 294/599] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:43:22.601067 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:22.601791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:22.609455 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:22.610012 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:22.620392 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:22.620392 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:22.620392 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:22.620392 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:22.745596 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:22.749756 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:22.754983 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:22.756424 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:22.757743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-556a2016-a3d2-4900-a708-77b3491a90f1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1406 microversion: 2.20 time: 0.161247 Sep 15 07:43:22.758302 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 306/600] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:22 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:23.784012 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:23.784701 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:23.790783 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:23.791259 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:23.791692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:23.792368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:23.792812 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:23.794262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:23.798279 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:23.923759 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:23.931974 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:23.933434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:23.934586 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0c1a9954-a7bd-4311-a6c3-525e9bb0833f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1406 microversion: 2.20 time: 0.155325 Sep 15 07:43:23.935214 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 295/601] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:23 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:24.959777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:24.960527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:24.968763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:24.969258 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:24.971331 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:24.971331 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:24.971331 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:24.971574 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:25.102652 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:25.111587 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:25.113028 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:25.114183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5b1f1383-a7a0-446e-a9d5-b11cf5da18e2 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1406 microversion: 2.20 time: 0.158405 Sep 15 07:43:25.114753 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 307/602] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:24 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:26.140593 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:26.141200 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:26.147501 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:26.148013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:26.148441 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:26.149119 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:26.149562 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:26.150005 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:26.279480 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:26.287537 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:26.288987 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:26.290211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-27479165-52ff-415e-9c66-791367688224 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1597 microversion: 2.20 time: 0.154495 Sep 15 07:43:26.290765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 296/603] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:43:26 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1597 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:43:26.314709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b8c5ed09-c7fd-4941-b1e1-d5960a147de4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:26.315822 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b8c5ed09-c7fd-4941-b1e1-d5960a147de4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:26.318218 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:26.322888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8c5ed09-c7fd-4941-b1e1-d5960a147de4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:26.323376 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8c5ed09-c7fd-4941-b1e1-d5960a147de4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:26.323807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8c5ed09-c7fd-4941-b1e1-d5960a147de4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:26.324546 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8c5ed09-c7fd-4941-b1e1-d5960a147de4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:26.325057 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8c5ed09-c7fd-4941-b1e1-d5960a147de4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:26.325475 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b8c5ed09-c7fd-4941-b1e1-d5960a147de4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:26.404280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b8c5ed09-c7fd-4941-b1e1-d5960a147de4 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093357 Sep 15 07:43:26.404877 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 308/604] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Sep 15 07:43:26 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 07:43:27.379624 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-6802f802-5795-46bb-9e17-25fcab3c4226 req-79b8e3e3-8a96-42f7-9354-4ec34f4718c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f14c845-5f86-4d74-8813-e7c482a6be08", "tag": "2f98d201-6410-4508-a7f3-40ecd7daed4f"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:27.391142 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-6802f802-5795-46bb-9e17-25fcab3c4226 req-79b8e3e3-8a96-42f7-9354-4ec34f4718c4 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:27.391590 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-6802f802-5795-46bb-9e17-25fcab3c4226 req-79b8e3e3-8a96-42f7-9354-4ec34f4718c4 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:27.392004 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-6802f802-5795-46bb-9e17-25fcab3c4226 req-79b8e3e3-8a96-42f7-9354-4ec34f4718c4 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:27.404003 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-6802f802-5795-46bb-9e17-25fcab3c4226 req-79b8e3e3-8a96-42f7-9354-4ec34f4718c4 service nova] Creating event network-changed:2f98d201-6410-4508-a7f3-40ecd7daed4f for instance 0f14c845-5f86-4d74-8813-e7c482a6be08 on hv-cinder-82414 Sep 15 07:43:27.408857 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-6802f802-5795-46bb-9e17-25fcab3c4226 req-79b8e3e3-8a96-42f7-9354-4ec34f4718c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032810 Sep 15 07:43:27.409600 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 297/605] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:43:29.494532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1fd4a1d0-ceef-4a19-9eaf-38e935c721fe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b38614d2-1c11-48c0-af44-bfdb0fa7df13"}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:29.497008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1fd4a1d0-ceef-4a19-9eaf-38e935c721fe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:29.503070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1fd4a1d0-ceef-4a19-9eaf-38e935c721fe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:29.503757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1fd4a1d0-ceef-4a19-9eaf-38e935c721fe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:29.504253 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1fd4a1d0-ceef-4a19-9eaf-38e935c721fe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:29.504886 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1fd4a1d0-ceef-4a19-9eaf-38e935c721fe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:29.505344 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1fd4a1d0-ceef-4a19-9eaf-38e935c721fe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:29.505807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1fd4a1d0-ceef-4a19-9eaf-38e935c721fe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:30.225728 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1fd4a1d0-ceef-4a19-9eaf-38e935c721fe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "POST /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735689 Sep 15 07:43:30.226348 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 309/606] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:43:29 2022] POST /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments => generated 194 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:43:37.799353 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:37.800086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=12 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:37.805439 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6c70900c-090c-4e4e-a1fb-d6892405b42a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:37.807773 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6c70900c-090c-4e4e-a1fb-d6892405b42a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:37.813848 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c70900c-090c-4e4e-a1fb-d6892405b42a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:37.814265 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c70900c-090c-4e4e-a1fb-d6892405b42a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:37.814699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c70900c-090c-4e4e-a1fb-d6892405b42a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:37.815377 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c70900c-090c-4e4e-a1fb-d6892405b42a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:37.815827 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c70900c-090c-4e4e-a1fb-d6892405b42a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:37.816275 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6c70900c-090c-4e4e-a1fb-d6892405b42a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:37.839949 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-6c70900c-090c-4e4e-a1fb-d6892405b42a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lazy-loading 'flavor' on Instance uuid 62a3489f-c5f3-44d4-93c2-da198e8f06f8 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:43:38.309320 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6c70900c-090c-4e4e-a1fb-d6892405b42a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "POST /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/action" status: 200 len: 32 microversion: 2.1 time: 0.511512 Sep 15 07:43:38.309970 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 298/607] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:43:37 2022] POST /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/action => generated 32 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 07:43:38.320763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-26c28f5e-410a-4ca0-ad61-7b59ffc37e91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:38.321483 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-26c28f5e-410a-4ca0-ad61-7b59ffc37e91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:38.329958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-26c28f5e-410a-4ca0-ad61-7b59ffc37e91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:38.330447 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-26c28f5e-410a-4ca0-ad61-7b59ffc37e91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:38.330913 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-26c28f5e-410a-4ca0-ad61-7b59ffc37e91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:38.331608 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-26c28f5e-410a-4ca0-ad61-7b59ffc37e91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:38.332055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-26c28f5e-410a-4ca0-ad61-7b59ffc37e91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:38.332628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-26c28f5e-410a-4ca0-ad61-7b59ffc37e91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:38.532092 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-26c28f5e-410a-4ca0-ad61-7b59ffc37e91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:38.540558 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-26c28f5e-410a-4ca0-ad61-7b59ffc37e91 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.224670 Sep 15 07:43:38.541399 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 310/608] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:38 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:43:39.565350 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f8c4775d-b766-497b-8e6c-c2c1a9b60836 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:39.566040 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f8c4775d-b766-497b-8e6c-c2c1a9b60836 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:39.572126 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8c4775d-b766-497b-8e6c-c2c1a9b60836 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:39.572605 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8c4775d-b766-497b-8e6c-c2c1a9b60836 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:39.573028 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8c4775d-b766-497b-8e6c-c2c1a9b60836 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:39.573737 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8c4775d-b766-497b-8e6c-c2c1a9b60836 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:39.574182 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8c4775d-b766-497b-8e6c-c2c1a9b60836 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:39.577332 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f8c4775d-b766-497b-8e6c-c2c1a9b60836 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:39.710770 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f8c4775d-b766-497b-8e6c-c2c1a9b60836 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:39.720404 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f8c4775d-b766-497b-8e6c-c2c1a9b60836 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.159733 Sep 15 07:43:39.721001 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 299/609] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:39 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:40.675070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1be651c1-e954-475b-b362-26042180c45e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:40.675632 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1be651c1-e954-475b-b362-26042180c45e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:40.683082 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1be651c1-e954-475b-b362-26042180c45e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:40.683568 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1be651c1-e954-475b-b362-26042180c45e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:40.684007 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1be651c1-e954-475b-b362-26042180c45e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:40.684705 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1be651c1-e954-475b-b362-26042180c45e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:40.685185 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1be651c1-e954-475b-b362-26042180c45e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:40.685624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1be651c1-e954-475b-b362-26042180c45e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:40.708893 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1be651c1-e954-475b-b362-26042180c45e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/ips" status: 200 len: 149 microversion: 2.1 time: 0.037620 Sep 15 07:43:40.709475 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 311/610] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 15 07:43:40 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:43:40.744843 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7b6b6830-0611-4c2f-bd88-95ea98e28ef7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:40.746053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7b6b6830-0611-4c2f-bd88-95ea98e28ef7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:40.753622 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7b6b6830-0611-4c2f-bd88-95ea98e28ef7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:40.754298 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7b6b6830-0611-4c2f-bd88-95ea98e28ef7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:40.754722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7b6b6830-0611-4c2f-bd88-95ea98e28ef7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:40.755594 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7b6b6830-0611-4c2f-bd88-95ea98e28ef7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:40.756039 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7b6b6830-0611-4c2f-bd88-95ea98e28ef7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:40.756663 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7b6b6830-0611-4c2f-bd88-95ea98e28ef7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:40.953271 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7b6b6830-0611-4c2f-bd88-95ea98e28ef7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:40.961738 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7b6b6830-0611-4c2f-bd88-95ea98e28ef7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.221279 Sep 15 07:43:40.964981 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 300/611] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:40 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:41.984342 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-717491a1-9e99-4dac-872c-746e124e190d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:41.984954 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-717491a1-9e99-4dac-872c-746e124e190d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:41.991440 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-717491a1-9e99-4dac-872c-746e124e190d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:41.996766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-717491a1-9e99-4dac-872c-746e124e190d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:41.996766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-717491a1-9e99-4dac-872c-746e124e190d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:41.996766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-717491a1-9e99-4dac-872c-746e124e190d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:41.996766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-717491a1-9e99-4dac-872c-746e124e190d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:41.997118 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-717491a1-9e99-4dac-872c-746e124e190d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:42.135556 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-717491a1-9e99-4dac-872c-746e124e190d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:42.144201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-717491a1-9e99-4dac-872c-746e124e190d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.163775 Sep 15 07:43:42.144758 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 312/612] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:41 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:42.288179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-17550def-dc32-43eb-b794-7c0281efac9e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:42.291234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-17550def-dc32-43eb-b794-7c0281efac9e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:42.297681 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-17550def-dc32-43eb-b794-7c0281efac9e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:42.303671 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-17550def-dc32-43eb-b794-7c0281efac9e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:42.303671 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-17550def-dc32-43eb-b794-7c0281efac9e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:42.303671 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-17550def-dc32-43eb-b794-7c0281efac9e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:42.303671 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-17550def-dc32-43eb-b794-7c0281efac9e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:42.304068 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-17550def-dc32-43eb-b794-7c0281efac9e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:42.896279 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-17550def-dc32-43eb-b794-7c0281efac9e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.611576 Sep 15 07:43:42.896818 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 301/613] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:43:42 2022] POST /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-volume_attachments => generated 194 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:43:43.168012 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1a3662cf-5d68-4a2b-bc7a-8dca336dde08 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:43.168527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1a3662cf-5d68-4a2b-bc7a-8dca336dde08 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:43.174837 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a3662cf-5d68-4a2b-bc7a-8dca336dde08 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:43.175314 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a3662cf-5d68-4a2b-bc7a-8dca336dde08 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:43.175752 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a3662cf-5d68-4a2b-bc7a-8dca336dde08 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:43.176439 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a3662cf-5d68-4a2b-bc7a-8dca336dde08 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:43.176891 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a3662cf-5d68-4a2b-bc7a-8dca336dde08 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:43.177320 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1a3662cf-5d68-4a2b-bc7a-8dca336dde08 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:43.306003 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1a3662cf-5d68-4a2b-bc7a-8dca336dde08 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:43.314222 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1a3662cf-5d68-4a2b-bc7a-8dca336dde08 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.150737 Sep 15 07:43:43.314777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 313/614] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:43 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:44.337891 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0dff7093-ed6f-436f-9121-291df05ceaa6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:44.338574 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0dff7093-ed6f-436f-9121-291df05ceaa6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:44.345076 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0dff7093-ed6f-436f-9121-291df05ceaa6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:44.345545 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0dff7093-ed6f-436f-9121-291df05ceaa6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:44.345995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0dff7093-ed6f-436f-9121-291df05ceaa6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:44.346678 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0dff7093-ed6f-436f-9121-291df05ceaa6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:44.347118 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0dff7093-ed6f-436f-9121-291df05ceaa6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:44.347532 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0dff7093-ed6f-436f-9121-291df05ceaa6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:44.484702 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0dff7093-ed6f-436f-9121-291df05ceaa6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:44.493471 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0dff7093-ed6f-436f-9121-291df05ceaa6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.159744 Sep 15 07:43:44.494013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 302/615] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:44 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:45.517760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6f769835-2d05-4aed-af1f-2156b39ed100 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:45.518448 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6f769835-2d05-4aed-af1f-2156b39ed100 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:45.525015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f769835-2d05-4aed-af1f-2156b39ed100 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:45.525498 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f769835-2d05-4aed-af1f-2156b39ed100 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:45.525963 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f769835-2d05-4aed-af1f-2156b39ed100 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:45.526652 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f769835-2d05-4aed-af1f-2156b39ed100 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:45.527105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f769835-2d05-4aed-af1f-2156b39ed100 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:45.527528 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6f769835-2d05-4aed-af1f-2156b39ed100 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:45.653435 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6f769835-2d05-4aed-af1f-2156b39ed100 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:45.661762 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6f769835-2d05-4aed-af1f-2156b39ed100 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.147930 Sep 15 07:43:45.662322 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 314/616] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:45 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:46.685558 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-fa92e354-229c-40ef-8832-882154512936 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:46.686211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-fa92e354-229c-40ef-8832-882154512936 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:46.692684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa92e354-229c-40ef-8832-882154512936 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:46.693156 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa92e354-229c-40ef-8832-882154512936 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:46.693604 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa92e354-229c-40ef-8832-882154512936 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:46.694279 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa92e354-229c-40ef-8832-882154512936 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:46.695572 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa92e354-229c-40ef-8832-882154512936 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:46.696000 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa92e354-229c-40ef-8832-882154512936 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:46.825553 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fa92e354-229c-40ef-8832-882154512936 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:46.833614 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-fa92e354-229c-40ef-8832-882154512936 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.151916 Sep 15 07:43:46.834182 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 303/617] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:46 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:47.858056 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-627acf98-9775-4c82-96fe-500a0e32f439 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:47.858675 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-627acf98-9775-4c82-96fe-500a0e32f439 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:47.865302 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-627acf98-9775-4c82-96fe-500a0e32f439 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:47.865833 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-627acf98-9775-4c82-96fe-500a0e32f439 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:47.866312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-627acf98-9775-4c82-96fe-500a0e32f439 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:47.867069 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-627acf98-9775-4c82-96fe-500a0e32f439 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:47.867531 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-627acf98-9775-4c82-96fe-500a0e32f439 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:47.867961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-627acf98-9775-4c82-96fe-500a0e32f439 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:47.997848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-627acf98-9775-4c82-96fe-500a0e32f439 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:48.005872 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-627acf98-9775-4c82-96fe-500a0e32f439 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.151747 Sep 15 07:43:48.006427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 315/618] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:47 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:49.028934 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-fa1b57b8-55cf-4bdf-af74-7860627b6ec9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:49.029606 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-fa1b57b8-55cf-4bdf-af74-7860627b6ec9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:49.035996 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1b57b8-55cf-4bdf-af74-7860627b6ec9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:49.036473 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1b57b8-55cf-4bdf-af74-7860627b6ec9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:49.036900 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1b57b8-55cf-4bdf-af74-7860627b6ec9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:49.037593 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1b57b8-55cf-4bdf-af74-7860627b6ec9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:49.038047 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1b57b8-55cf-4bdf-af74-7860627b6ec9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:49.038614 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fa1b57b8-55cf-4bdf-af74-7860627b6ec9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:49.168632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fa1b57b8-55cf-4bdf-af74-7860627b6ec9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:49.179539 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-fa1b57b8-55cf-4bdf-af74-7860627b6ec9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.154571 Sep 15 07:43:49.180126 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 304/619] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:49 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:50.202952 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2fba5418-4766-4531-828e-b28478018351 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:50.203577 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2fba5418-4766-4531-828e-b28478018351 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:50.211485 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2fba5418-4766-4531-828e-b28478018351 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:50.211969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2fba5418-4766-4531-828e-b28478018351 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:50.212405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2fba5418-4766-4531-828e-b28478018351 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:50.213090 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2fba5418-4766-4531-828e-b28478018351 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:50.213546 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2fba5418-4766-4531-828e-b28478018351 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:50.213996 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2fba5418-4766-4531-828e-b28478018351 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:50.343264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2fba5418-4766-4531-828e-b28478018351 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:50.352402 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2fba5418-4766-4531-828e-b28478018351 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.153249 Sep 15 07:43:50.352951 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 316/620] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:50 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:50.620385 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:50.622917 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:50.629427 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:50.629981 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:50.630416 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:50.631858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:50.632548 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:50.634022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:50.711937 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Invalid volume: volume 3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66 is already attached to instances: 93a02c55-496c-4b57-9af0-d40fba32857e Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: POST /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-volume_attachments HTTP/1.1 Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 74 Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:43:50.713722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {"volumeAttachment": {"volumeId": "3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66"}} Sep 15 07:43:50.715231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Invalid volume: volume 3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66 is already attached to instances: 93a02c55-496c-4b57-9af0-d40fba32857e Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'server_id': '93a02c55-496c-4b57-9af0-d40fba32857e', 'body': {'volumeAttachment': {'volumeId': '3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66'}}} Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66 is already attached to instances: 93a02c55-496c-4b57-9af0-d40fba32857e Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:50.716116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66 is already attached to instances: 93a02c55-496c-4b57-9af0-d40fba32857e Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:50.717493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:43:50.719061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:43:50.719061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:43:50.719061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:43:50.719061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66 is already attached to instances: 93a02c55-496c-4b57-9af0-d40fba32857e Sep 15 07:43:50.719061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:50.719061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 400 to user: Invalid volume: volume 3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66 is already attached to instances: 93a02c55-496c-4b57-9af0-d40fba32857e {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:43:50.719061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f52d42b8-cf51-4da2-8ff6-7ce23ebb48bc tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098846 Sep 15 07:43:50.719061 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 305/621] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:43:50 2022] POST /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 07:43:50.780630 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6ad13418-5182-47f9-ad8e-ed078c704b29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:50.781122 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6ad13418-5182-47f9-ad8e-ed078c704b29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:50.787052 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6ad13418-5182-47f9-ad8e-ed078c704b29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:50.787655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6ad13418-5182-47f9-ad8e-ed078c704b29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:50.788087 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6ad13418-5182-47f9-ad8e-ed078c704b29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:50.788763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6ad13418-5182-47f9-ad8e-ed078c704b29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:50.789209 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6ad13418-5182-47f9-ad8e-ed078c704b29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:50.789652 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6ad13418-5182-47f9-ad8e-ed078c704b29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:50.869348 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-6ad13418-5182-47f9-ad8e-ed078c704b29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lazy-loading 'services' on Instance uuid 93a02c55-496c-4b57-9af0-d40fba32857e {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:43:51.043680 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6ad13418-5182-47f9-ad8e-ed078c704b29 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-volume_attachments/3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66" status: 202 len: 0 microversion: 2.1 time: 0.266710 Sep 15 07:43:51.044264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 317/622] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:43:50 2022] DELETE /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-volume_attachments/3f7b0003-8ed1-45c6-89c7-1fe8b80e6a66 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:43:51.052621 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7a08d628-6f74-4834-a4e9-497ce1c83e22 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:51.055139 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7a08d628-6f74-4834-a4e9-497ce1c83e22 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:51.061364 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a08d628-6f74-4834-a4e9-497ce1c83e22 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:51.061908 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a08d628-6f74-4834-a4e9-497ce1c83e22 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:51.062346 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a08d628-6f74-4834-a4e9-497ce1c83e22 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:51.063080 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a08d628-6f74-4834-a4e9-497ce1c83e22 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:51.063537 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a08d628-6f74-4834-a4e9-497ce1c83e22 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:51.063959 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a08d628-6f74-4834-a4e9-497ce1c83e22 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:51.094812 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7a08d628-6f74-4834-a4e9-497ce1c83e22 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 Sep 15 07:43:51.095367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 306/623] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:43:51 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:43:51.376413 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d76d3f44-0bf9-4a28-be61-a23456c4dffe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:51.377033 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d76d3f44-0bf9-4a28-be61-a23456c4dffe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:51.384194 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d76d3f44-0bf9-4a28-be61-a23456c4dffe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:51.384706 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d76d3f44-0bf9-4a28-be61-a23456c4dffe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:51.385138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d76d3f44-0bf9-4a28-be61-a23456c4dffe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:51.385859 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d76d3f44-0bf9-4a28-be61-a23456c4dffe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:51.386312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d76d3f44-0bf9-4a28-be61-a23456c4dffe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:51.386735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d76d3f44-0bf9-4a28-be61-a23456c4dffe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:51.517385 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d76d3f44-0bf9-4a28-be61-a23456c4dffe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:51.526531 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d76d3f44-0bf9-4a28-be61-a23456c4dffe tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.154886 Sep 15 07:43:51.527098 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 318/624] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:51 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:52.107782 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-251e1688-c779-4dac-b373-e7688278cbc0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:52.110035 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-251e1688-c779-4dac-b373-e7688278cbc0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:52.117052 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-251e1688-c779-4dac-b373-e7688278cbc0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:52.117543 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-251e1688-c779-4dac-b373-e7688278cbc0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:52.118019 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-251e1688-c779-4dac-b373-e7688278cbc0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:52.118721 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-251e1688-c779-4dac-b373-e7688278cbc0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:52.119233 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-251e1688-c779-4dac-b373-e7688278cbc0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:52.119687 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-251e1688-c779-4dac-b373-e7688278cbc0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:52.151960 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-251e1688-c779-4dac-b373-e7688278cbc0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048491 Sep 15 07:43:52.155733 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 307/625] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:43:52 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 07:43:52.217174 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3a2f13d4-14b6-411e-9211-4809c906aada tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:52.217694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3a2f13d4-14b6-411e-9211-4809c906aada tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:52.223757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a2f13d4-14b6-411e-9211-4809c906aada tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:52.224240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a2f13d4-14b6-411e-9211-4809c906aada tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:52.224703 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a2f13d4-14b6-411e-9211-4809c906aada tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:52.226105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a2f13d4-14b6-411e-9211-4809c906aada tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:52.226575 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a2f13d4-14b6-411e-9211-4809c906aada tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:52.226998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a2f13d4-14b6-411e-9211-4809c906aada tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:52.252707 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3a2f13d4-14b6-411e-9211-4809c906aada tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:43:52.488659 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3a2f13d4-14b6-411e-9211-4809c906aada tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 204 len: 0 microversion: 2.1 time: 0.274926 Sep 15 07:43:52.489336 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 319/626] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:43:52 2022] DELETE /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:43:52.497309 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6d93e160-b131-49e8-b47a-d77e2a96fabf tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:52.497988 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6d93e160-b131-49e8-b47a-d77e2a96fabf tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:52.503949 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d93e160-b131-49e8-b47a-d77e2a96fabf tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:52.504446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d93e160-b131-49e8-b47a-d77e2a96fabf tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:52.504871 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d93e160-b131-49e8-b47a-d77e2a96fabf tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:52.505695 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d93e160-b131-49e8-b47a-d77e2a96fabf tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:52.506548 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d93e160-b131-49e8-b47a-d77e2a96fabf tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:52.506985 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d93e160-b131-49e8-b47a-d77e2a96fabf tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:52.549940 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6b2bc7c9-057c-40c0-b0ee-8ff4e37f534a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:52.552814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6b2bc7c9-057c-40c0-b0ee-8ff4e37f534a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:52.556956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6b2bc7c9-057c-40c0-b0ee-8ff4e37f534a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:52.557436 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6b2bc7c9-057c-40c0-b0ee-8ff4e37f534a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:52.557892 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6b2bc7c9-057c-40c0-b0ee-8ff4e37f534a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:52.558582 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6b2bc7c9-057c-40c0-b0ee-8ff4e37f534a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:52.559141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6b2bc7c9-057c-40c0-b0ee-8ff4e37f534a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:52.559563 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6b2bc7c9-057c-40c0-b0ee-8ff4e37f534a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:52.578830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:52.676770 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6d93e160-b131-49e8-b47a-d77e2a96fabf tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:52.685181 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6d93e160-b131-49e8-b47a-d77e2a96fabf tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1682 microversion: 2.1 time: 0.191623 Sep 15 07:43:52.685882 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 308/627] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:52 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:52.720049 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6b2bc7c9-057c-40c0-b0ee-8ff4e37f534a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:52.728801 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6b2bc7c9-057c-40c0-b0ee-8ff4e37f534a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.183181 Sep 15 07:43:52.729374 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 320/628] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:52 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:43:53.708879 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d03be5c1-1860-4fea-97fa-a1de8f25bf82 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:53.709525 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d03be5c1-1860-4fea-97fa-a1de8f25bf82 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:53.715889 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d03be5c1-1860-4fea-97fa-a1de8f25bf82 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:53.716370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d03be5c1-1860-4fea-97fa-a1de8f25bf82 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:53.716800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d03be5c1-1860-4fea-97fa-a1de8f25bf82 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:53.717474 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d03be5c1-1860-4fea-97fa-a1de8f25bf82 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:53.717986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d03be5c1-1860-4fea-97fa-a1de8f25bf82 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:53.718400 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d03be5c1-1860-4fea-97fa-a1de8f25bf82 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:53.752166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-335ba424-cbdb-41aa-8cdd-3d20749d4057 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:53.752874 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-335ba424-cbdb-41aa-8cdd-3d20749d4057 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:53.760596 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-335ba424-cbdb-41aa-8cdd-3d20749d4057 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:53.761081 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-335ba424-cbdb-41aa-8cdd-3d20749d4057 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:53.761519 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-335ba424-cbdb-41aa-8cdd-3d20749d4057 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:53.762248 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-335ba424-cbdb-41aa-8cdd-3d20749d4057 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:53.762696 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-335ba424-cbdb-41aa-8cdd-3d20749d4057 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:53.772672 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-335ba424-cbdb-41aa-8cdd-3d20749d4057 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:53.904727 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d03be5c1-1860-4fea-97fa-a1de8f25bf82 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:53.913012 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d03be5c1-1860-4fea-97fa-a1de8f25bf82 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1682 microversion: 2.1 time: 0.208565 Sep 15 07:43:53.913626 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 309/629] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:53 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:53.931819 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-335ba424-cbdb-41aa-8cdd-3d20749d4057 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:53.939998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-335ba424-cbdb-41aa-8cdd-3d20749d4057 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.191624 Sep 15 07:43:53.940720 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 321/630] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:53 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:43:54.936509 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-819fc3a3-04f6-4d2d-8a70-ceb520f54fa9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:54.937807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-819fc3a3-04f6-4d2d-8a70-ceb520f54fa9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:54.958934 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-819fc3a3-04f6-4d2d-8a70-ceb520f54fa9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:54.958934 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-819fc3a3-04f6-4d2d-8a70-ceb520f54fa9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:54.964349 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7908a270-8136-4947-bcd7-436fbe7f688e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:54.964966 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7908a270-8136-4947-bcd7-436fbe7f688e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:54.968960 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-819fc3a3-04f6-4d2d-8a70-ceb520f54fa9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:54.969849 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-819fc3a3-04f6-4d2d-8a70-ceb520f54fa9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:54.970326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-819fc3a3-04f6-4d2d-8a70-ceb520f54fa9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:54.970753 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-819fc3a3-04f6-4d2d-8a70-ceb520f54fa9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:54.972179 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7908a270-8136-4947-bcd7-436fbe7f688e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:54.972675 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7908a270-8136-4947-bcd7-436fbe7f688e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:54.973114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7908a270-8136-4947-bcd7-436fbe7f688e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:54.974033 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7908a270-8136-4947-bcd7-436fbe7f688e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:54.974830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7908a270-8136-4947-bcd7-436fbe7f688e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:54.975496 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7908a270-8136-4947-bcd7-436fbe7f688e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:55.077059 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-819fc3a3-04f6-4d2d-8a70-ceb520f54fa9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:55.087045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-819fc3a3-04f6-4d2d-8a70-ceb520f54fa9 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1614 microversion: 2.1 time: 0.154424 Sep 15 07:43:55.102029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 310/631] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:54 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1614 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:55.102029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-7e9c7386-4876-416a-95d9-e748158c1e42 req-a0b82cd5-ea8c-4c6e-ba9d-9de94c08113d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a02c55-496c-4b57-9af0-d40fba32857e", "name": "network-vif-deleted", "tag": "590166b6-cdd3-443d-ba8a-e41ad7c63879"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:55.107925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-7e9c7386-4876-416a-95d9-e748158c1e42 req-a0b82cd5-ea8c-4c6e-ba9d-9de94c08113d service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:55.107925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-7e9c7386-4876-416a-95d9-e748158c1e42 req-a0b82cd5-ea8c-4c6e-ba9d-9de94c08113d service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:55.107925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-7e9c7386-4876-416a-95d9-e748158c1e42 req-a0b82cd5-ea8c-4c6e-ba9d-9de94c08113d service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:55.113559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:55.123614 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-7e9c7386-4876-416a-95d9-e748158c1e42 req-a0b82cd5-ea8c-4c6e-ba9d-9de94c08113d service nova] Creating event network-vif-deleted:590166b6-cdd3-443d-ba8a-e41ad7c63879 for instance 93a02c55-496c-4b57-9af0-d40fba32857e on hv-cinder-82414 Sep 15 07:43:55.131350 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-7e9c7386-4876-416a-95d9-e748158c1e42 req-a0b82cd5-ea8c-4c6e-ba9d-9de94c08113d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041487 Sep 15 07:43:55.132372 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 311/632] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:43:55.149310 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7908a270-8136-4947-bcd7-436fbe7f688e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:55.157715 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7908a270-8136-4947-bcd7-436fbe7f688e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.197217 Sep 15 07:43:55.158488 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 322/633] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:54 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:56.116720 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:56.117341 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:56.124280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:56.124766 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:56.125199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:56.125910 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:56.126364 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:56.126787 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:56.168873 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:56.169352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:56.169819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:56.170266 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lazy-loading 'fault' on Instance uuid 93a02c55-496c-4b57-9af0-d40fba32857e {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:43:56.182262 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-57422385-5337-445a-88fb-38d88dc9c8da tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:56.182885 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-57422385-5337-445a-88fb-38d88dc9c8da tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:56.189689 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-57422385-5337-445a-88fb-38d88dc9c8da tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:56.190184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-57422385-5337-445a-88fb-38d88dc9c8da tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:56.190628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-57422385-5337-445a-88fb-38d88dc9c8da tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:56.191330 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-57422385-5337-445a-88fb-38d88dc9c8da tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:56.191787 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-57422385-5337-445a-88fb-38d88dc9c8da tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:56.192265 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-57422385-5337-445a-88fb-38d88dc9c8da tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:56.212921 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:56.220676 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6badce75-27f3-425e-9896-5802477b8340 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 200 len: 1332 microversion: 2.1 time: 0.109173 Sep 15 07:43:56.221315 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 312/634] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:56 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:56.322321 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-57422385-5337-445a-88fb-38d88dc9c8da tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:56.330703 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-57422385-5337-445a-88fb-38d88dc9c8da tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1736 microversion: 2.1 time: 0.152282 Sep 15 07:43:56.331410 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 323/635] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:56 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:57.244581 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:57.245256 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:57.251514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:57.251995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:57.252427 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:57.253110 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:57.253565 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:57.253998 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:57.267658 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e HTTP/1.1 Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:43:57.269277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:43:57.272048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '93a02c55-496c-4b57-9af0-d40fba32857e'} Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:43:57.272930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:43:57.274514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:43:57.275836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:43:57.275836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ad5caad6-657f-4b6f-bb40-7128e87ef05d tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 404 len: 111 microversion: 2.1 time: 0.030417 Sep 15 07:43:57.275836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 313/636] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:57 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:43:57.279929 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e8814c21-c345-48fb-9a0d-477cbb2317c5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '.version_select at 0x7ff36c8b6040>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:57.287310 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:43:57.354229 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-00354ced-2f0b-4bd2-953f-7f3c350cca49 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:57.354868 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-00354ced-2f0b-4bd2-953f-7f3c350cca49 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:57.360963 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-00354ced-2f0b-4bd2-953f-7f3c350cca49 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:57.361460 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-00354ced-2f0b-4bd2-953f-7f3c350cca49 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:57.361926 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-00354ced-2f0b-4bd2-953f-7f3c350cca49 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:57.362651 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-00354ced-2f0b-4bd2-953f-7f3c350cca49 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:57.363109 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-00354ced-2f0b-4bd2-953f-7f3c350cca49 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:57.364139 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-00354ced-2f0b-4bd2-953f-7f3c350cca49 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:57.368392 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e8814c21-c345-48fb-9a0d-477cbb2317c5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130214131" status: 202 len: 0 microversion: 2.1 time: 0.092215 Sep 15 07:43:57.369165 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 324/637] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Sep 15 07:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130214131 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:43:57.503571 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-00354ced-2f0b-4bd2-953f-7f3c350cca49 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:57.513025 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-00354ced-2f0b-4bd2-953f-7f3c350cca49 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1716 microversion: 2.1 time: 0.162583 Sep 15 07:43:57.513765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 314/638] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:57 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:43:57.669714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:57.670206 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:57.676935 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:57.677494 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:57.678095 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:57.678898 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:57.679414 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:57.679927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:57.766188 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] HTTP exception thrown: Cannot 'detach_volume' instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 while it is in vm_state rescued Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Request method failure captured: Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: DELETE /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments/b38614d2-1c11-48c0-af44-bfdb0fa7df13 HTTP/1.1 Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItbY2L3ItdqVaB73YjwArZPr23BmX6ENHNLZJT2WdCDXyeVG5CK5pKWhEyleF5-RV2_raaWI0zXKOH-9Z9AH41lx9iUPkkpesBFRI5O9kzzv1YOcB8Wq1WkZItvtzmzZi5ZqhWF1QiKcU657CscGnDcQ5M8Dmr2TKDeM6OBUI71wxrM Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: cdc69db806d24d1f8eb18aadaaafabcb Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:43:57.767805 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:43:57.769354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdc69db806d24d1f8eb18aadaaafabcb"}]}] Sep 15 07:43:57.769354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:43:57.769354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: cdc69db806d24d1f8eb18aadaaafabcb Sep 15 07:43:57.769354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:43:57.769354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-ServerRescueNegativeTestJSON-192071295-project Sep 15 07:43:57.769354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:43:57.769354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:43:57.769354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 21de3a85b2df4af2833a24ab02f477c8 Sep 15 07:43:57.769354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-ServerRescueNegativeTestJSON-192071295-project Sep 15 07:43:57.769354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:43:57.769354 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Cannot 'detach_volume' instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 while it is in vm_state rescued Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'server_id': '62a3489f-c5f3-44d4-93c2-da198e8f06f8', 'id': 'b38614d2-1c11-48c0-af44-bfdb0fa7df13'} Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:43:57.770918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 while it is in vm_state rescued Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 while it is in vm_state rescued Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:43:57.772338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Returning 409 to user: Cannot 'detach_volume' instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 while it is in vm_state rescued {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:43:57.773555 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7d7c191e-4163-4353-9489-4043b3e533b6 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "DELETE /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments/b38614d2-1c11-48c0-af44-bfdb0fa7df13" status: 409 len: 152 microversion: 2.1 time: 0.104195 Sep 15 07:43:57.774346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 325/639] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:43:57 2022] DELETE /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments/b38614d2-1c11-48c0-af44-bfdb0fa7df13 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 15 07:43:57.779392 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-654c329d-fa98-47dc-a9d1-f144b35ef41d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:57.779924 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-654c329d-fa98-47dc-a9d1-f144b35ef41d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:57.787027 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-654c329d-fa98-47dc-a9d1-f144b35ef41d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:57.787504 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-654c329d-fa98-47dc-a9d1-f144b35ef41d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:57.787952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-654c329d-fa98-47dc-a9d1-f144b35ef41d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:57.788896 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-654c329d-fa98-47dc-a9d1-f144b35ef41d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:57.789402 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-654c329d-fa98-47dc-a9d1-f144b35ef41d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:57.789886 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-654c329d-fa98-47dc-a9d1-f144b35ef41d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:57.987738 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-654c329d-fa98-47dc-a9d1-f144b35ef41d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "POST /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/action" status: 202 len: 0 microversion: 2.1 time: 0.212184 Sep 15 07:43:57.988988 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 315/640] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:43:57 2022] POST /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:43:57.997376 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-8f6aa434-f4d7-4e32-b501-b86489643170 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:57.998018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-8f6aa434-f4d7-4e32-b501-b86489643170 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:58.004195 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f6aa434-f4d7-4e32-b501-b86489643170 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:58.005094 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f6aa434-f4d7-4e32-b501-b86489643170 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:58.005537 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f6aa434-f4d7-4e32-b501-b86489643170 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:58.008482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f6aa434-f4d7-4e32-b501-b86489643170 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:58.008482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f6aa434-f4d7-4e32-b501-b86489643170 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:58.008482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8f6aa434-f4d7-4e32-b501-b86489643170 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:58.145296 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8f6aa434-f4d7-4e32-b501-b86489643170 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:58.154162 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-8f6aa434-f4d7-4e32-b501-b86489643170 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1724 microversion: 2.1 time: 0.160753 Sep 15 07:43:58.160870 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 326/641] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:57 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:43:58.182809 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f91473dd-d3f6-43b2-b9ff-c0ef47df740a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: .version_select at 0x7ff36c8b5b80>, body: {"keypair": {"name": "tempest-keypair-1113243292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrTsbrcXKfQWyJuqJBsnu4avVzLlG0JLMeizCsrhwg+OvhhquRXvSwq5RVP3lQN0YWCOjWyCURz8VLaAMXttNod5U4kEyjcTyF1iXcUIJ5oroyjoJ7UbhFlTGqZ4HZZpA=="}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:43:58.198836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-f91473dd-d3f6-43b2-b9ff-c0ef47df740a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for project 14017d5edbbd4068b529d5d92444182a. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:43:58.202939 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-f91473dd-d3f6-43b2-b9ff-c0ef47df740a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for user 5e0c8d7aa4db455a94631becf212866f and project 14017d5edbbd4068b529d5d92444182a. Resources: {'key_pairs'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:43:58.265168 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f91473dd-d3f6-43b2-b9ff-c0ef47df740a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086473 Sep 15 07:43:58.265850 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 316/642] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 15 07:43:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:43:59.178422 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c691a49d-ee9c-4186-8050-f270061b7977 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:43:59.179145 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c691a49d-ee9c-4186-8050-f270061b7977 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:43:59.187177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c691a49d-ee9c-4186-8050-f270061b7977 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:59.187722 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c691a49d-ee9c-4186-8050-f270061b7977 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:59.188196 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c691a49d-ee9c-4186-8050-f270061b7977 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:59.188898 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c691a49d-ee9c-4186-8050-f270061b7977 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:43:59.189357 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c691a49d-ee9c-4186-8050-f270061b7977 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:43:59.189818 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c691a49d-ee9c-4186-8050-f270061b7977 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:43:59.339814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c691a49d-ee9c-4186-8050-f270061b7977 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:43:59.348264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c691a49d-ee9c-4186-8050-f270061b7977 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1724 microversion: 2.1 time: 0.174468 Sep 15 07:43:59.348825 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 327/643] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:43:59 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:00.372087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b242c6c2-a5ab-4408-bd7f-71ee92c9320a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:00.373088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b242c6c2-a5ab-4408-bd7f-71ee92c9320a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:00.379572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-281936945", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be4fe7de-ab91-47eb-96fc-2000373fe74e"}], "security_groups": [{"name": "tempest-securitygroup--320921570"}], "key_name": "tempest-keypair-1113243292", "user_data": "}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:00.381839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b242c6c2-a5ab-4408-bd7f-71ee92c9320a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:00.382333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b242c6c2-a5ab-4408-bd7f-71ee92c9320a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:00.382773 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b242c6c2-a5ab-4408-bd7f-71ee92c9320a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:00.383474 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b242c6c2-a5ab-4408-bd7f-71ee92c9320a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:00.383934 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b242c6c2-a5ab-4408-bd7f-71ee92c9320a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:00.384361 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b242c6c2-a5ab-4408-bd7f-71ee92c9320a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:00.759216 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.network.neutron [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] validate_networks() for [('be4fe7de-ab91-47eb-96fc-2000373fe74e', None, None, None, None, None)] {{(pid=132674) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:44:00.827917 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b242c6c2-a5ab-4408-bd7f-71ee92c9320a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:00.836607 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b242c6c2-a5ab-4408-bd7f-71ee92c9320a tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1730 microversion: 2.1 time: 0.468387 Sep 15 07:44:00.837175 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 317/644] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:00 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1730 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:00.858947 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8eb31a81-fcf8-4cf1-ab2b-35933041ba7f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:00.859446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8eb31a81-fcf8-4cf1-ab2b-35933041ba7f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:00.866268 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8eb31a81-fcf8-4cf1-ab2b-35933041ba7f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:00.866759 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8eb31a81-fcf8-4cf1-ab2b-35933041ba7f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:00.867199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8eb31a81-fcf8-4cf1-ab2b-35933041ba7f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:00.867902 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8eb31a81-fcf8-4cf1-ab2b-35933041ba7f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:00.868359 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8eb31a81-fcf8-4cf1-ab2b-35933041ba7f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:00.868786 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8eb31a81-fcf8-4cf1-ab2b-35933041ba7f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:00.976278 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8eb31a81-fcf8-4cf1-ab2b-35933041ba7f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121099 Sep 15 07:44:00.976870 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 318/645] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 15 07:44:00 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:44:01.453110 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Flavor limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:44:01.453629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Image limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:44:01.454092 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Flavor pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:44:01.454503 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Image pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:44:01.454918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:44:01.464589 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:01.465070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:01.465625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:01.466384 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:01.466837 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:01.467273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:01.484922 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for project 14017d5edbbd4068b529d5d92444182a. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:44:01.490034 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Getting quotas for user 5e0c8d7aa4db455a94631becf212866f and project 14017d5edbbd4068b529d5d92444182a. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:44:01.501307 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Going to run 1 instances... {{(pid=132674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:44:01.504255 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:44:01.633452 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a2055a3e-c58b-4efe-8097-f71ef81248a7 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.259241 Sep 15 07:44:01.634166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 328/646] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:44:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 07:44:01.646734 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ebe8e588-8aff-4e1b-a4b2-97ea2d48a946 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:01.647341 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ebe8e588-8aff-4e1b-a4b2-97ea2d48a946 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:01.702199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ebe8e588-8aff-4e1b-a4b2-97ea2d48a946 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:01.710111 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ebe8e588-8aff-4e1b-a4b2-97ea2d48a946 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1241 microversion: 2.1 time: 0.068428 Sep 15 07:44:01.710699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 319/647] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:01 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:02.211998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-c5940a72-eb82-42d7-89c2-7e3ce1102908 req-1782faa6-54d5-4aed-9fd7-b0e1c4bea3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a3489f-c5f3-44d4-93c2-da198e8f06f8", "tag": "5143816a-5379-4a8d-ad85-0a16d1348b1e"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:02.223721 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-c5940a72-eb82-42d7-89c2-7e3ce1102908 req-1782faa6-54d5-4aed-9fd7-b0e1c4bea3ed service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:02.224444 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-c5940a72-eb82-42d7-89c2-7e3ce1102908 req-1782faa6-54d5-4aed-9fd7-b0e1c4bea3ed service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:02.228597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-c5940a72-eb82-42d7-89c2-7e3ce1102908 req-1782faa6-54d5-4aed-9fd7-b0e1c4bea3ed service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:02.236585 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-c5940a72-eb82-42d7-89c2-7e3ce1102908 req-1782faa6-54d5-4aed-9fd7-b0e1c4bea3ed service nova] Creating event network-changed:5143816a-5379-4a8d-ad85-0a16d1348b1e for instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 on hv-cinder-82414 Sep 15 07:44:02.242653 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-c5940a72-eb82-42d7-89c2-7e3ce1102908 req-1782faa6-54d5-4aed-9fd7-b0e1c4bea3ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181946 Sep 15 07:44:02.246179 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 329/648] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:44:02.733425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ae20f900-c336-4be6-b367-5301b7bc1357 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:02.733991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ae20f900-c336-4be6-b367-5301b7bc1357 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:02.742465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae20f900-c336-4be6-b367-5301b7bc1357 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:02.742986 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae20f900-c336-4be6-b367-5301b7bc1357 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:02.743430 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae20f900-c336-4be6-b367-5301b7bc1357 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:02.744132 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae20f900-c336-4be6-b367-5301b7bc1357 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:02.744587 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae20f900-c336-4be6-b367-5301b7bc1357 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:02.745184 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae20f900-c336-4be6-b367-5301b7bc1357 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:02.806547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ae20f900-c336-4be6-b367-5301b7bc1357 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:02.814366 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ae20f900-c336-4be6-b367-5301b7bc1357 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1245 microversion: 2.1 time: 0.084920 Sep 15 07:44:02.815373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 320/649] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:02 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:03.645884 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e821fe81-9ef5-4f00-8acf-c9d31426e55f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:03.646482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e821fe81-9ef5-4f00-8acf-c9d31426e55f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:03.652631 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e821fe81-9ef5-4f00-8acf-c9d31426e55f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:03.653118 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e821fe81-9ef5-4f00-8acf-c9d31426e55f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:03.653564 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e821fe81-9ef5-4f00-8acf-c9d31426e55f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:03.654281 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e821fe81-9ef5-4f00-8acf-c9d31426e55f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:03.654745 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e821fe81-9ef5-4f00-8acf-c9d31426e55f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:03.655178 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e821fe81-9ef5-4f00-8acf-c9d31426e55f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:03.679698 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e821fe81-9ef5-4f00-8acf-c9d31426e55f tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/ips" status: 200 len: 151 microversion: 2.20 time: 0.137735 Sep 15 07:44:03.680254 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 330/650] 10.222.0.42 () {60 vars in 1289 bytes} [Thu Sep 15 07:44:03 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/ips => generated 151 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:44:03.837418 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b2aa2ad8-ef58-417f-bca9-508fe5ab0f04 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:03.838070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b2aa2ad8-ef58-417f-bca9-508fe5ab0f04 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:03.844576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ad8-ef58-417f-bca9-508fe5ab0f04 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:03.845065 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ad8-ef58-417f-bca9-508fe5ab0f04 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:03.845519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ad8-ef58-417f-bca9-508fe5ab0f04 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:03.846261 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ad8-ef58-417f-bca9-508fe5ab0f04 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:03.846718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ad8-ef58-417f-bca9-508fe5ab0f04 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:03.848271 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b2aa2ad8-ef58-417f-bca9-508fe5ab0f04 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:03.917601 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b2aa2ad8-ef58-417f-bca9-508fe5ab0f04 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:03.925529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b2aa2ad8-ef58-417f-bca9-508fe5ab0f04 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1301 microversion: 2.1 time: 0.092339 Sep 15 07:44:03.926430 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 321/651] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:03 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:04.259488 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-040a2783-4b59-44e6-a792-0404ef8b4a1c req-a7e6ee7b-be7a-4342-9af2-7e1d702b17d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a3489f-c5f3-44d4-93c2-da198e8f06f8", "tag": "5143816a-5379-4a8d-ad85-0a16d1348b1e"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:04.269622 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-040a2783-4b59-44e6-a792-0404ef8b4a1c req-a7e6ee7b-be7a-4342-9af2-7e1d702b17d7 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:04.270212 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-040a2783-4b59-44e6-a792-0404ef8b4a1c req-a7e6ee7b-be7a-4342-9af2-7e1d702b17d7 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:04.270652 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-040a2783-4b59-44e6-a792-0404ef8b4a1c req-a7e6ee7b-be7a-4342-9af2-7e1d702b17d7 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:04.281826 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-040a2783-4b59-44e6-a792-0404ef8b4a1c req-a7e6ee7b-be7a-4342-9af2-7e1d702b17d7 service nova] Creating event network-changed:5143816a-5379-4a8d-ad85-0a16d1348b1e for instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 on hv-cinder-82414 Sep 15 07:44:04.287123 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-040a2783-4b59-44e6-a792-0404ef8b4a1c req-a7e6ee7b-be7a-4342-9af2-7e1d702b17d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031481 Sep 15 07:44:04.288120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 331/652] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:44:04.950185 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-575a9a81-ecdf-4415-9a70-d2eda00c18e4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:04.950742 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-575a9a81-ecdf-4415-9a70-d2eda00c18e4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:04.959236 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-575a9a81-ecdf-4415-9a70-d2eda00c18e4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:04.959861 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-575a9a81-ecdf-4415-9a70-d2eda00c18e4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:04.960381 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-575a9a81-ecdf-4415-9a70-d2eda00c18e4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:04.961012 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-575a9a81-ecdf-4415-9a70-d2eda00c18e4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:04.961489 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-575a9a81-ecdf-4415-9a70-d2eda00c18e4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:04.961928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-575a9a81-ecdf-4415-9a70-d2eda00c18e4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:05.101017 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-575a9a81-ecdf-4415-9a70-d2eda00c18e4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:05.108742 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-575a9a81-ecdf-4415-9a70-d2eda00c18e4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1366 microversion: 2.1 time: 0.162930 Sep 15 07:44:05.110554 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 322/653] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:04 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:05.879712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-08075824-a9f1-4c3a-85d3-fd5f10b01830 req-038f303d-c9ec-45a1-8ec7-862822d2c30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07952150-a64f-434a-8fcc-d7ff89215b84", "tag": "c0246052-5807-47eb-9a0b-f3f27149228f"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:05.890258 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-08075824-a9f1-4c3a-85d3-fd5f10b01830 req-038f303d-c9ec-45a1-8ec7-862822d2c30d service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:05.896064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-08075824-a9f1-4c3a-85d3-fd5f10b01830 req-038f303d-c9ec-45a1-8ec7-862822d2c30d service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:05.896064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-08075824-a9f1-4c3a-85d3-fd5f10b01830 req-038f303d-c9ec-45a1-8ec7-862822d2c30d service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:05.902636 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-08075824-a9f1-4c3a-85d3-fd5f10b01830 req-038f303d-c9ec-45a1-8ec7-862822d2c30d service nova] Creating event network-changed:c0246052-5807-47eb-9a0b-f3f27149228f for instance 07952150-a64f-434a-8fcc-d7ff89215b84 on hv-cinder-82414 Sep 15 07:44:05.908053 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-08075824-a9f1-4c3a-85d3-fd5f10b01830 req-038f303d-c9ec-45a1-8ec7-862822d2c30d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033052 Sep 15 07:44:05.909129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 332/654] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:44:06.027160 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-54af252f-1c1b-4b39-9718-7400f968e10c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:06.027792 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-54af252f-1c1b-4b39-9718-7400f968e10c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:06.034636 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-54af252f-1c1b-4b39-9718-7400f968e10c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:06.035106 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-54af252f-1c1b-4b39-9718-7400f968e10c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:06.035604 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-54af252f-1c1b-4b39-9718-7400f968e10c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:06.036357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-54af252f-1c1b-4b39-9718-7400f968e10c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:06.036926 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-54af252f-1c1b-4b39-9718-7400f968e10c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:06.038549 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-54af252f-1c1b-4b39-9718-7400f968e10c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:06.061416 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-54af252f-1c1b-4b39-9718-7400f968e10c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lazy-loading 'flavor' on Instance uuid 0f14c845-5f86-4d74-8813-e7c482a6be08 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:44:06.133337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-72114ebe-e257-4eee-9efe-7a3e52368ecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:06.134071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-72114ebe-e257-4eee-9efe-7a3e52368ecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:06.140273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-72114ebe-e257-4eee-9efe-7a3e52368ecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:06.141016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-72114ebe-e257-4eee-9efe-7a3e52368ecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:06.141643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-72114ebe-e257-4eee-9efe-7a3e52368ecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:06.146918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-72114ebe-e257-4eee-9efe-7a3e52368ecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:06.146918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-72114ebe-e257-4eee-9efe-7a3e52368ecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:06.146918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-72114ebe-e257-4eee-9efe-7a3e52368ecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:06.288158 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-72114ebe-e257-4eee-9efe-7a3e52368ecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:06.297053 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-72114ebe-e257-4eee-9efe-7a3e52368ecb tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1366 microversion: 2.1 time: 0.168441 Sep 15 07:44:06.303330 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 333/655] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:06 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:44:06.456539 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-54af252f-1c1b-4b39-9718-7400f968e10c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "POST /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/action" status: 202 len: 0 microversion: 2.20 time: 0.432595 Sep 15 07:44:06.457239 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 323/656] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 15 07:44:06 2022] POST /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:44:06.465482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:06.466149 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:06.472240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:06.472713 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:06.473150 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:06.473880 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:06.474334 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:06.474764 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:06.610618 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:06.619504 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:06.620966 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:06.622169 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0b72c284-a5d1-4f14-b16f-1a82a6036675 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.160620 Sep 15 07:44:06.622726 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 334/657] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:06 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:07.321937 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c370d36d-073d-4e21-b60b-35c9ebe7fdd5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:07.322626 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c370d36d-073d-4e21-b60b-35c9ebe7fdd5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:07.328813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c370d36d-073d-4e21-b60b-35c9ebe7fdd5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:07.329289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c370d36d-073d-4e21-b60b-35c9ebe7fdd5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:07.329751 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c370d36d-073d-4e21-b60b-35c9ebe7fdd5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:07.330681 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c370d36d-073d-4e21-b60b-35c9ebe7fdd5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:07.331155 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c370d36d-073d-4e21-b60b-35c9ebe7fdd5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:07.331576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c370d36d-073d-4e21-b60b-35c9ebe7fdd5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:07.462279 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c370d36d-073d-4e21-b60b-35c9ebe7fdd5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:07.469951 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c370d36d-073d-4e21-b60b-35c9ebe7fdd5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1366 microversion: 2.1 time: 0.152684 Sep 15 07:44:07.470525 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 324/658] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:07 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:07.648411 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:07.648976 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:07.655358 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:07.655842 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:07.656280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:07.656965 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:07.657419 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:07.657870 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:07.786830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:07.795141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:07.796595 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:07.797964 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b1973f1e-38b5-46ca-88c4-e60b3faec10d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.153550 Sep 15 07:44:07.798524 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 335/659] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:07 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:08.493157 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-058d1626-465f-4fe9-8566-fc9779cbb36b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:08.493809 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-058d1626-465f-4fe9-8566-fc9779cbb36b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:08.496237 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:08.500917 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-058d1626-465f-4fe9-8566-fc9779cbb36b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:08.501396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-058d1626-465f-4fe9-8566-fc9779cbb36b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:08.502535 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-058d1626-465f-4fe9-8566-fc9779cbb36b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:08.503369 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-058d1626-465f-4fe9-8566-fc9779cbb36b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:08.503814 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-058d1626-465f-4fe9-8566-fc9779cbb36b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:08.504233 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-058d1626-465f-4fe9-8566-fc9779cbb36b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:08.635283 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-058d1626-465f-4fe9-8566-fc9779cbb36b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:08.643462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-058d1626-465f-4fe9-8566-fc9779cbb36b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1366 microversion: 2.1 time: 0.154155 Sep 15 07:44:08.644035 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 325/660] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:08 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:08.823625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:08.824247 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:08.830760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:08.831249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:08.831685 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:08.832374 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:08.832832 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:08.833257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:08.961480 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:08.969773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:08.971272 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:08.972432 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-58584066-0ea1-49c8-8159-548bc590d5eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.152904 Sep 15 07:44:08.972988 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 336/661] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:08 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:09.665981 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8828d595-d15e-48e5-9017-76d9915c3d8b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:09.666604 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8828d595-d15e-48e5-9017-76d9915c3d8b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:09.672967 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8828d595-d15e-48e5-9017-76d9915c3d8b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:09.674384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8828d595-d15e-48e5-9017-76d9915c3d8b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:09.674835 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8828d595-d15e-48e5-9017-76d9915c3d8b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:09.675584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8828d595-d15e-48e5-9017-76d9915c3d8b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:09.676043 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8828d595-d15e-48e5-9017-76d9915c3d8b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:09.676485 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8828d595-d15e-48e5-9017-76d9915c3d8b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:09.807176 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8828d595-d15e-48e5-9017-76d9915c3d8b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:09.814975 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8828d595-d15e-48e5-9017-76d9915c3d8b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1366 microversion: 2.1 time: 0.152879 Sep 15 07:44:09.816821 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 326/662] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:09 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:09.998320 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:09.998965 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:10.008528 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:10.009166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:10.009643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:10.010349 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:10.010827 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:10.011246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:10.140177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:10.148905 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:10.150442 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:10.151613 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-70e9befd-37df-4a73-b7da-54eefdbffc99 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.157181 Sep 15 07:44:10.152177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 337/663] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:09 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:10.837688 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c31dc8d2-79e5-403f-9b14-cccf1fb7a95b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:10.838254 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c31dc8d2-79e5-403f-9b14-cccf1fb7a95b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:10.844787 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c31dc8d2-79e5-403f-9b14-cccf1fb7a95b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:10.845266 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c31dc8d2-79e5-403f-9b14-cccf1fb7a95b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:10.845813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c31dc8d2-79e5-403f-9b14-cccf1fb7a95b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:10.846514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c31dc8d2-79e5-403f-9b14-cccf1fb7a95b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:10.846969 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c31dc8d2-79e5-403f-9b14-cccf1fb7a95b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:10.847389 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c31dc8d2-79e5-403f-9b14-cccf1fb7a95b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:10.974327 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c31dc8d2-79e5-403f-9b14-cccf1fb7a95b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:10.982100 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c31dc8d2-79e5-403f-9b14-cccf1fb7a95b tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1366 microversion: 2.1 time: 0.148321 Sep 15 07:44:10.982664 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 327/664] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:10 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:11.178018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:11.178592 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:11.185049 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:11.185531 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:11.186001 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:11.186692 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:11.187146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:11.187571 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:11.317786 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:11.325835 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:11.327290 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:11.328448 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7aa90a14-ca23-4064-978b-76dc990cc363 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.154644 Sep 15 07:44:11.329000 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 338/665] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:11 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:12.005313 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-825fdf6c-f457-4f3d-8e73-ea6a927c4f1c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:12.005958 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-825fdf6c-f457-4f3d-8e73-ea6a927c4f1c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:12.007991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=6 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:12.013200 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-825fdf6c-f457-4f3d-8e73-ea6a927c4f1c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:12.013712 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-825fdf6c-f457-4f3d-8e73-ea6a927c4f1c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:12.014150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-825fdf6c-f457-4f3d-8e73-ea6a927c4f1c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:12.014843 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-825fdf6c-f457-4f3d-8e73-ea6a927c4f1c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:12.015289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-825fdf6c-f457-4f3d-8e73-ea6a927c4f1c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:12.015740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-825fdf6c-f457-4f3d-8e73-ea6a927c4f1c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:12.020438 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:12.146593 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-825fdf6c-f457-4f3d-8e73-ea6a927c4f1c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:12.154100 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-825fdf6c-f457-4f3d-8e73-ea6a927c4f1c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1366 microversion: 2.1 time: 0.152920 Sep 15 07:44:12.154659 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 328/666] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:12 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:12.355627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:12.356240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:12.358210 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:12.358871 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=6 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:12.364981 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:12.367702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:12.367702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:12.367702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:12.367702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:12.368079 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:12.504331 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:12.512834 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:12.514346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:12.515518 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-06444b8e-48b4-445c-b69b-21604c48f711 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.163797 Sep 15 07:44:12.516812 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 339/667] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:12 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:12.639187 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-e2dda3ae-eb7a-45fd-9cac-41c2d07efd70 req-934ae142-19a0-4f57-be61-b275287549fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07952150-a64f-434a-8fcc-d7ff89215b84", "name": "network-vif-plugged", "status": "completed", "tag": "c0246052-5807-47eb-9a0b-f3f27149228f"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:12.648819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-e2dda3ae-eb7a-45fd-9cac-41c2d07efd70 req-934ae142-19a0-4f57-be61-b275287549fa service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:12.654538 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-e2dda3ae-eb7a-45fd-9cac-41c2d07efd70 req-934ae142-19a0-4f57-be61-b275287549fa service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:12.654538 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-e2dda3ae-eb7a-45fd-9cac-41c2d07efd70 req-934ae142-19a0-4f57-be61-b275287549fa service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:12.660720 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-e2dda3ae-eb7a-45fd-9cac-41c2d07efd70 req-934ae142-19a0-4f57-be61-b275287549fa service nova] Creating event network-vif-plugged:c0246052-5807-47eb-9a0b-f3f27149228f for instance 07952150-a64f-434a-8fcc-d7ff89215b84 on hv-cinder-82414 Sep 15 07:44:12.666321 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-e2dda3ae-eb7a-45fd-9cac-41c2d07efd70 req-934ae142-19a0-4f57-be61-b275287549fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090299 Sep 15 07:44:12.667117 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 329/668] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:44:13.176489 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-760632ad-329c-4f71-b05f-67afaa9c9a0a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:13.177241 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-760632ad-329c-4f71-b05f-67afaa9c9a0a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:13.183308 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-760632ad-329c-4f71-b05f-67afaa9c9a0a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:13.183784 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-760632ad-329c-4f71-b05f-67afaa9c9a0a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:13.184212 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-760632ad-329c-4f71-b05f-67afaa9c9a0a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:13.184900 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-760632ad-329c-4f71-b05f-67afaa9c9a0a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:13.185349 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-760632ad-329c-4f71-b05f-67afaa9c9a0a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:13.185798 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-760632ad-329c-4f71-b05f-67afaa9c9a0a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:13.318979 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-760632ad-329c-4f71-b05f-67afaa9c9a0a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:13.326564 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-760632ad-329c-4f71-b05f-67afaa9c9a0a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1366 microversion: 2.1 time: 0.154203 Sep 15 07:44:13.327140 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 340/669] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:13 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:13.542809 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:13.543546 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:13.550295 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:13.550770 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:13.551198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:13.551876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:13.552323 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:13.552738 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:13.690672 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:13.698937 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:13.700366 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:13.701596 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-87425ab4-fd37-4a3f-bc87-df28a5d8a402 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.163493 Sep 15 07:44:13.702165 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 330/670] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:13 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:14.350102 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fb6a8818-0920-46e2-bd12-0b67db3d9751 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:14.350718 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-fb6a8818-0920-46e2-bd12-0b67db3d9751 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:14.357052 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fb6a8818-0920-46e2-bd12-0b67db3d9751 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:14.357531 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fb6a8818-0920-46e2-bd12-0b67db3d9751 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:14.357999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fb6a8818-0920-46e2-bd12-0b67db3d9751 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:14.358682 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fb6a8818-0920-46e2-bd12-0b67db3d9751 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:14.359133 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fb6a8818-0920-46e2-bd12-0b67db3d9751 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:14.359554 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fb6a8818-0920-46e2-bd12-0b67db3d9751 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:14.364707 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:14.492012 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-fb6a8818-0920-46e2-bd12-0b67db3d9751 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:14.499662 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fb6a8818-0920-46e2-bd12-0b67db3d9751 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1366 microversion: 2.1 time: 0.153446 Sep 15 07:44:14.500329 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 341/671] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:14 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:14.727255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:14.727806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:14.734133 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:14.740087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:14.740087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:14.740087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:14.740087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:14.740470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:14.864174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:14.872150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:14.873607 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:14.874775 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ae6e74d6-2ac1-4d1b-b444-fcff1def2558 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.151558 Sep 15 07:44:14.875343 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 331/672] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:14 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:15.524276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0b156d7c-7aaf-483b-9fdf-1e38831a227f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:15.524818 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0b156d7c-7aaf-483b-9fdf-1e38831a227f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:15.531406 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b156d7c-7aaf-483b-9fdf-1e38831a227f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:15.532572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b156d7c-7aaf-483b-9fdf-1e38831a227f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:15.533066 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b156d7c-7aaf-483b-9fdf-1e38831a227f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:15.533784 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b156d7c-7aaf-483b-9fdf-1e38831a227f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:15.534235 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b156d7c-7aaf-483b-9fdf-1e38831a227f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:15.534656 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b156d7c-7aaf-483b-9fdf-1e38831a227f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:15.667316 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0b156d7c-7aaf-483b-9fdf-1e38831a227f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:15.678863 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0b156d7c-7aaf-483b-9fdf-1e38831a227f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1555 microversion: 2.1 time: 0.158291 Sep 15 07:44:15.679817 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 342/673] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:15 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:15.701693 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-648a3d4b-a35b-47c8-8966-0e4760c6f9ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:15.702213 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-648a3d4b-a35b-47c8-8966-0e4760c6f9ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:15.708666 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-648a3d4b-a35b-47c8-8966-0e4760c6f9ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:15.709166 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-648a3d4b-a35b-47c8-8966-0e4760c6f9ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:15.709594 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-648a3d4b-a35b-47c8-8966-0e4760c6f9ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:15.710286 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-648a3d4b-a35b-47c8-8966-0e4760c6f9ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:15.710743 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-648a3d4b-a35b-47c8-8966-0e4760c6f9ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:15.711165 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-648a3d4b-a35b-47c8-8966-0e4760c6f9ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:15.787716 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-648a3d4b-a35b-47c8-8966-0e4760c6f9ad tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089822 Sep 15 07:44:15.788314 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 332/674] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 15 07:44:15 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:44:15.900468 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:15.901113 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:15.907112 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:15.907605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:15.908037 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:15.908724 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:15.909171 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:15.909603 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:16.043921 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:16.052226 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:16.053756 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:16.054921 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-83e7423e-8607-4773-a676-deb823e3da65 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.158495 Sep 15 07:44:16.055479 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 343/675] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:15 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:16.815774 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-a4344801-dd34-4ebc-9e27-e03860aa0603 req-f4d29a1b-4e48-4c95-89a5-f6118e63b2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07952150-a64f-434a-8fcc-d7ff89215b84", "tag": "c0246052-5807-47eb-9a0b-f3f27149228f"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:16.825433 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-a4344801-dd34-4ebc-9e27-e03860aa0603 req-f4d29a1b-4e48-4c95-89a5-f6118e63b2d0 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:16.826005 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-a4344801-dd34-4ebc-9e27-e03860aa0603 req-f4d29a1b-4e48-4c95-89a5-f6118e63b2d0 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:16.826494 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-a4344801-dd34-4ebc-9e27-e03860aa0603 req-f4d29a1b-4e48-4c95-89a5-f6118e63b2d0 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:16.837913 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-a4344801-dd34-4ebc-9e27-e03860aa0603 req-f4d29a1b-4e48-4c95-89a5-f6118e63b2d0 service nova] Creating event network-changed:c0246052-5807-47eb-9a0b-f3f27149228f for instance 07952150-a64f-434a-8fcc-d7ff89215b84 on hv-cinder-82414 Sep 15 07:44:16.842819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-a4344801-dd34-4ebc-9e27-e03860aa0603 req-f4d29a1b-4e48-4c95-89a5-f6118e63b2d0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084832 Sep 15 07:44:16.843493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 333/676] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:44:17.080689 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:17.081297 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:17.087890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:17.088375 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:17.089007 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:17.089733 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:17.090185 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:17.090605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:17.230722 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:17.239975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:17.241699 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:17.242869 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-cf62dca6-2e63-4511-8adf-27266478c237 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.166427 Sep 15 07:44:17.243622 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 344/677] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:17 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:18.269840 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:18.270531 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:18.276722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:18.277197 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:18.277659 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:18.278335 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:18.278897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:18.279316 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:18.408677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:18.416686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:18.418143 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:18.419295 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4649c188-ad12-46a4-9e8f-fd6ee0917f49 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.154404 Sep 15 07:44:18.419940 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 334/678] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:18 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:44:19.445787 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:19.446388 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:19.457695 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:19.458181 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:19.458615 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:19.459311 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:19.459772 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:19.460192 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:19.592569 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:19.601418 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:19.602863 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:19.604119 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c6b92df1-3f23-43ac-9532-7fc63ccdc6d1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.162887 Sep 15 07:44:19.604666 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 345/679] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:19 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:20.630170 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:20.630782 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:20.637254 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:20.637793 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:20.638233 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:20.638922 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:20.639381 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:20.639806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:20.767424 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:20.775490 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:20.776965 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:20.778184 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6fffd0de-ae23-4cfd-bb7b-2ae1dac9dce6 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.152636 Sep 15 07:44:20.778744 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 335/680] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:20 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:21.803351 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:21.803958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:21.810437 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:21.810914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:21.811341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:21.812017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:21.812460 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:21.813538 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:21.944695 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:21.950772 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:21.952223 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:21.954046 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-17a6452b-d478-40e1-be4a-62f0227184fb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.153980 Sep 15 07:44:21.954615 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 346/681] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:21 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:22.979357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:22.979958 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:22.986517 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:22.987014 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:22.987441 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:22.988113 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:22.988557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:22.988972 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:23.335364 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:23.343638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:23.345356 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:23.346535 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bd5adcbd-ff4b-415b-a456-87b934d65b3d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1743 microversion: 2.20 time: 0.371051 Sep 15 07:44:23.347096 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 336/682] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:22 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1743 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:24.371250 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:24.371809 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:24.378997 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:24.379480 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:24.379922 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:24.380614 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:24.381071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:24.381521 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:24.519115 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:24.527509 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:24.530223 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:24.530223 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9386dc20-84c2-4da6-8662-65f1d771e1e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1738 microversion: 2.20 time: 0.162917 Sep 15 07:44:24.530981 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 347/683] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:24 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:25.560365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:25.560961 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:25.568793 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:25.569285 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:25.569749 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:25.570457 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:25.570908 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:25.571325 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:25.721383 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:25.730246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:25.731696 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:25.732869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-93648fd4-f641-47be-8610-551f84ff8164 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1738 microversion: 2.20 time: 0.176379 Sep 15 07:44:25.748387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 337/684] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:25 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:26.608840 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-4e0f22bb-13af-412f-8d08-90fa15f8baa1 req-390e68ab-e6e8-425f-8adf-6e573bc8d5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f14c845-5f86-4d74-8813-e7c482a6be08", "name": "network-vif-plugged", "status": "completed", "tag": "2f98d201-6410-4508-a7f3-40ecd7daed4f"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:26.621909 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4e0f22bb-13af-412f-8d08-90fa15f8baa1 req-390e68ab-e6e8-425f-8adf-6e573bc8d5b4 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:26.622945 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4e0f22bb-13af-412f-8d08-90fa15f8baa1 req-390e68ab-e6e8-425f-8adf-6e573bc8d5b4 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:26.623583 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4e0f22bb-13af-412f-8d08-90fa15f8baa1 req-390e68ab-e6e8-425f-8adf-6e573bc8d5b4 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:26.636051 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-4e0f22bb-13af-412f-8d08-90fa15f8baa1 req-390e68ab-e6e8-425f-8adf-6e573bc8d5b4 service nova] Creating event network-vif-plugged:2f98d201-6410-4508-a7f3-40ecd7daed4f for instance 0f14c845-5f86-4d74-8813-e7c482a6be08 on hv-cinder-82414 Sep 15 07:44:26.650727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-4e0f22bb-13af-412f-8d08-90fa15f8baa1 req-390e68ab-e6e8-425f-8adf-6e573bc8d5b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045446 Sep 15 07:44:26.651647 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 348/685] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:44:26.760115 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:26.761519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:26.773629 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:26.774228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:26.774995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:26.775769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:26.776455 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:26.777122 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:26.957451 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:26.966685 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:26.968769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:26.970251 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5b4a861d-8258-4b13-a7ed-967ed2ec5c5e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1738 microversion: 2.20 time: 0.214052 Sep 15 07:44:26.971315 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 338/686] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:26 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:27.999975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:28.000826 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:28.003188 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:28.008818 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:28.009317 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:28.009882 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:28.010637 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:28.011113 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:28.011550 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:28.159694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:28.168000 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:28.169457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:28.171428 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5f52da93-6a1f-4a7b-9462-2f1bc8b7b610 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1738 microversion: 2.20 time: 0.178544 Sep 15 07:44:28.171992 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 349/687] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:27 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:29.196504 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:29.197849 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:29.205807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:29.206306 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:29.206746 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:29.207454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:29.207911 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:29.208370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:29.353674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:29.362320 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:29.364023 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:29.365250 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-156e1113-4a6d-43c8-8d3f-aada17bff8e5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1738 microversion: 2.20 time: 0.172784 Sep 15 07:44:29.378159 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 339/688] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:29 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:30.393251 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:30.395305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:30.402197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:30.402691 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:30.403138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:30.403941 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:30.405027 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:30.405515 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:30.572036 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:30.581788 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:30.583238 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:30.584679 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-cbc91940-8fe1-48ec-b774-42dfa1de9631 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1738 microversion: 2.20 time: 0.196293 Sep 15 07:44:30.589138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 350/689] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:30 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:31.611034 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:31.611718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:31.621089 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:31.621855 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:31.622300 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:31.623110 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:31.623582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:31.624007 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:31.772118 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:31.785789 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:31.787317 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:31.788522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-aaf41eb4-1d43-4cc9-accc-98cc1891f084 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1738 microversion: 2.20 time: 0.182083 Sep 15 07:44:31.789293 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 340/690] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:31 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:32.820196 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:32.820906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:32.828030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:32.828524 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:32.828968 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:32.829714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:32.830198 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:32.830665 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:32.976451 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:32.985240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:32.986878 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:32.988033 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-102ebdc9-2b81-4ee8-b545-e24f69cfb857 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1738 microversion: 2.20 time: 0.171800 Sep 15 07:44:32.990949 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 351/691] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:32 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:34.014979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:34.015590 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:34.022737 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:34.023224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:34.023654 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:34.024410 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:34.024885 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:34.025306 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:34.170646 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:34.180022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:34.181672 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:34.182970 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-373ecd84-a156-4771-8823-efd8dc71fd61 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1738 microversion: 2.20 time: 0.172046 Sep 15 07:44:34.183577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 341/692] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:34 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:34.602664 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-caa26c33-6ad6-4c35-b51e-afcff2a5211d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:34.603163 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-caa26c33-6ad6-4c35-b51e-afcff2a5211d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:34.610393 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-caa26c33-6ad6-4c35-b51e-afcff2a5211d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:34.610874 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-caa26c33-6ad6-4c35-b51e-afcff2a5211d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:34.611312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-caa26c33-6ad6-4c35-b51e-afcff2a5211d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:34.612001 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-caa26c33-6ad6-4c35-b51e-afcff2a5211d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:34.612453 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-caa26c33-6ad6-4c35-b51e-afcff2a5211d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:34.612877 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-caa26c33-6ad6-4c35-b51e-afcff2a5211d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:34.695704 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-caa26c33-6ad6-4c35-b51e-afcff2a5211d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lazy-loading 'services' on Instance uuid 62a3489f-c5f3-44d4-93c2-da198e8f06f8 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:44:34.874278 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-caa26c33-6ad6-4c35-b51e-afcff2a5211d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "DELETE /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments/b38614d2-1c11-48c0-af44-bfdb0fa7df13" status: 202 len: 0 microversion: 2.1 time: 0.275091 Sep 15 07:44:34.875567 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 352/693] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:44:34 2022] DELETE /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments/b38614d2-1c11-48c0-af44-bfdb0fa7df13 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 07:44:34.883923 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a3c755a3-049f-45b0-8435-392ab5ac3c3f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:34.886834 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a3c755a3-049f-45b0-8435-392ab5ac3c3f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:34.893491 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a3c755a3-049f-45b0-8435-392ab5ac3c3f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:34.894135 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a3c755a3-049f-45b0-8435-392ab5ac3c3f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:34.894651 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a3c755a3-049f-45b0-8435-392ab5ac3c3f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:34.895375 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a3c755a3-049f-45b0-8435-392ab5ac3c3f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:34.895853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a3c755a3-049f-45b0-8435-392ab5ac3c3f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:34.896423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a3c755a3-049f-45b0-8435-392ab5ac3c3f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:34.934094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a3c755a3-049f-45b0-8435-392ab5ac3c3f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054151 Sep 15 07:44:34.935280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 342/694] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:44:34 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:44:35.211844 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:35.212945 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:35.221526 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:35.222350 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:35.222791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:35.223516 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:35.223969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:35.224398 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:35.374714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:35.390049 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:35.391979 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:35.394076 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e481dc2d-d2cb-4515-82e7-1758f7bdf909 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1738 microversion: 2.20 time: 0.186525 Sep 15 07:44:35.394837 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 353/695] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:35 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:35.946984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-373df2bc-289c-4901-a73c-44e87f0b47c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:35.950347 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-373df2bc-289c-4901-a73c-44e87f0b47c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:35.957125 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373df2bc-289c-4901-a73c-44e87f0b47c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:35.957975 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373df2bc-289c-4901-a73c-44e87f0b47c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:35.958537 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373df2bc-289c-4901-a73c-44e87f0b47c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:35.959274 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373df2bc-289c-4901-a73c-44e87f0b47c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:35.959918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373df2bc-289c-4901-a73c-44e87f0b47c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:35.960354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-373df2bc-289c-4901-a73c-44e87f0b47c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:35.994361 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-373df2bc-289c-4901-a73c-44e87f0b47c0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051741 Sep 15 07:44:35.994943 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 343/696] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:44:35 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:44:36.424353 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:36.424975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:36.431559 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:36.432823 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:36.432823 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:36.433186 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:36.433660 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:36.434089 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:36.589271 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:36.598405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:36.599928 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:36.601159 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-274f9749-84f0-4ef3-991b-2fae5e112ef8 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1720 microversion: 2.20 time: 0.180794 Sep 15 07:44:36.601894 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 354/697] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:36 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:37.008135 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4991a71d-15ec-41c6-a313-40ed0b46c2a8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:37.010948 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4991a71d-15ec-41c6-a313-40ed0b46c2a8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:37.018044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4991a71d-15ec-41c6-a313-40ed0b46c2a8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:37.018527 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4991a71d-15ec-41c6-a313-40ed0b46c2a8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:37.018954 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4991a71d-15ec-41c6-a313-40ed0b46c2a8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:37.019639 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4991a71d-15ec-41c6-a313-40ed0b46c2a8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:37.020087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4991a71d-15ec-41c6-a313-40ed0b46c2a8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:37.020505 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4991a71d-15ec-41c6-a313-40ed0b46c2a8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:37.049833 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4991a71d-15ec-41c6-a313-40ed0b46c2a8 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045755 Sep 15 07:44:37.050723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 344/698] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:44:37 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 07:44:37.132327 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-40d325de-30ed-4dd1-ac9d-98b27d851d38 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:37.132824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-40d325de-30ed-4dd1-ac9d-98b27d851d38 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:37.139549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40d325de-30ed-4dd1-ac9d-98b27d851d38 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:37.140034 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40d325de-30ed-4dd1-ac9d-98b27d851d38 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:37.140469 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40d325de-30ed-4dd1-ac9d-98b27d851d38 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:37.141157 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40d325de-30ed-4dd1-ac9d-98b27d851d38 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:37.141628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40d325de-30ed-4dd1-ac9d-98b27d851d38 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:37.142051 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40d325de-30ed-4dd1-ac9d-98b27d851d38 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:37.165956 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-40d325de-30ed-4dd1-ac9d-98b27d851d38 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:44:37.425497 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-40d325de-30ed-4dd1-ac9d-98b27d851d38 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "DELETE /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 204 len: 0 microversion: 2.1 time: 0.296635 Sep 15 07:44:37.426166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 355/699] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:44:37 2022] DELETE /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:44:37.434927 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3b2fb8a0-884e-4d13-9281-2c500f757356 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:37.435750 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3b2fb8a0-884e-4d13-9281-2c500f757356 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:37.441732 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3b2fb8a0-884e-4d13-9281-2c500f757356 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:37.442212 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3b2fb8a0-884e-4d13-9281-2c500f757356 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:37.442645 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3b2fb8a0-884e-4d13-9281-2c500f757356 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:37.443324 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3b2fb8a0-884e-4d13-9281-2c500f757356 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:37.443771 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3b2fb8a0-884e-4d13-9281-2c500f757356 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:37.444186 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3b2fb8a0-884e-4d13-9281-2c500f757356 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:37.578794 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3b2fb8a0-884e-4d13-9281-2c500f757356 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:37.586455 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3b2fb8a0-884e-4d13-9281-2c500f757356 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1690 microversion: 2.1 time: 0.156105 Sep 15 07:44:37.587028 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 345/700] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:37 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:37.629035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:37.629773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:37.635604 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:37.636108 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:37.636546 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:37.637230 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:37.637714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:37.638719 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:37.643255 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:37.769471 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:37.778229 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:37.780216 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:37.781374 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a0bfe0e7-fb0c-40ab-b7ff-613a310c9d90 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1720 microversion: 2.20 time: 0.157066 Sep 15 07:44:37.781988 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 356/701] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:37 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:38.610727 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-57f0f83d-0ba4-4a84-9928-bdae6b12fe6f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:38.611323 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-57f0f83d-0ba4-4a84-9928-bdae6b12fe6f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:38.613699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=42 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:38.618316 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f0f83d-0ba4-4a84-9928-bdae6b12fe6f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:38.618790 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f0f83d-0ba4-4a84-9928-bdae6b12fe6f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:38.619220 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f0f83d-0ba4-4a84-9928-bdae6b12fe6f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:38.619904 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f0f83d-0ba4-4a84-9928-bdae6b12fe6f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:38.620606 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f0f83d-0ba4-4a84-9928-bdae6b12fe6f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:38.621024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-57f0f83d-0ba4-4a84-9928-bdae6b12fe6f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:38.639302 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=100 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:38.756357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-57f0f83d-0ba4-4a84-9928-bdae6b12fe6f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:38.764779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-57f0f83d-0ba4-4a84-9928-bdae6b12fe6f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1690 microversion: 2.1 time: 0.158537 Sep 15 07:44:38.765351 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 346/702] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:38 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:38.812572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:38.813177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:38.819725 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:38.820199 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:38.820631 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:38.821305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:38.821786 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:38.822214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:38.950239 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:38.959729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:38.961189 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:38.962401 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-576f117c-3bed-469d-a9b3-5dc9f5f016e9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1720 microversion: 2.20 time: 0.154248 Sep 15 07:44:38.962946 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 357/703] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:38 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:39.787594 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ee499acd-0b00-499c-b3b8-94ff27e316f0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:39.788228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ee499acd-0b00-499c-b3b8-94ff27e316f0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:39.795629 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ee499acd-0b00-499c-b3b8-94ff27e316f0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:39.795629 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ee499acd-0b00-499c-b3b8-94ff27e316f0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:39.796055 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ee499acd-0b00-499c-b3b8-94ff27e316f0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:39.796736 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ee499acd-0b00-499c-b3b8-94ff27e316f0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:39.797187 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ee499acd-0b00-499c-b3b8-94ff27e316f0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:39.797634 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ee499acd-0b00-499c-b3b8-94ff27e316f0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:39.925499 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ee499acd-0b00-499c-b3b8-94ff27e316f0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:39.933036 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ee499acd-0b00-499c-b3b8-94ff27e316f0 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1690 microversion: 2.1 time: 0.149324 Sep 15 07:44:39.933622 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 347/704] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:39 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:39.988590 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:39.989291 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:39.996001 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:39.996490 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:39.997413 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:39.998242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:39.999056 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:39.999056 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:40.125808 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:40.133827 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:40.135280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:40.136471 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0d9c8eb1-1edf-4dcf-98fb-375ac827f7d9 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1720 microversion: 2.20 time: 0.151808 Sep 15 07:44:40.137030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 358/705] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:39 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:40.610166 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-b7eb1bcf-1437-401d-8b0c-8d9def705f8b req-1ca97fae-de6f-4153-8715-4f7d98a6c4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f14c845-5f86-4d74-8813-e7c482a6be08", "name": "network-vif-unplugged", "status": "completed", "tag": "2f98d201-6410-4508-a7f3-40ecd7daed4f"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:40.619376 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-b7eb1bcf-1437-401d-8b0c-8d9def705f8b req-1ca97fae-de6f-4153-8715-4f7d98a6c4c2 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:40.620117 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-b7eb1bcf-1437-401d-8b0c-8d9def705f8b req-1ca97fae-de6f-4153-8715-4f7d98a6c4c2 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:40.620538 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-b7eb1bcf-1437-401d-8b0c-8d9def705f8b req-1ca97fae-de6f-4153-8715-4f7d98a6c4c2 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:40.631794 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-b7eb1bcf-1437-401d-8b0c-8d9def705f8b req-1ca97fae-de6f-4153-8715-4f7d98a6c4c2 service nova] Creating event network-vif-unplugged:2f98d201-6410-4508-a7f3-40ecd7daed4f for instance 0f14c845-5f86-4d74-8813-e7c482a6be08 on hv-cinder-82414 Sep 15 07:44:40.639655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-b7eb1bcf-1437-401d-8b0c-8d9def705f8b req-1ca97fae-de6f-4153-8715-4f7d98a6c4c2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030277 Sep 15 07:44:40.639655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 348/706] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:44:40.957064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0810e768-769b-4b98-a585-b09e86642791 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:40.957711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0810e768-769b-4b98-a585-b09e86642791 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:40.963954 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0810e768-769b-4b98-a585-b09e86642791 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:40.964436 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0810e768-769b-4b98-a585-b09e86642791 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:40.964872 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0810e768-769b-4b98-a585-b09e86642791 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:40.966275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0810e768-769b-4b98-a585-b09e86642791 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:40.967029 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0810e768-769b-4b98-a585-b09e86642791 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:40.967461 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0810e768-769b-4b98-a585-b09e86642791 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:41.099917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0810e768-769b-4b98-a585-b09e86642791 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:41.107522 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0810e768-769b-4b98-a585-b09e86642791 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1690 microversion: 2.1 time: 0.154382 Sep 15 07:44:41.108090 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 359/707] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:40 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:41.162922 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:41.163602 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:41.169604 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:41.170092 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:41.170523 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:41.171199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:41.171645 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:41.172060 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:41.297991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:41.305813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:41.307237 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:41.308375 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-12a2ac20-b093-4c6d-a981-a58e53226ab7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1720 microversion: 2.20 time: 0.150106 Sep 15 07:44:41.308932 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 349/708] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:41 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:42.130177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-25a805bd-2768-4d48-9bd0-52c3fe2c7f86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:42.130831 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-25a805bd-2768-4d48-9bd0-52c3fe2c7f86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:42.137298 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25a805bd-2768-4d48-9bd0-52c3fe2c7f86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:42.138132 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25a805bd-2768-4d48-9bd0-52c3fe2c7f86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:42.138576 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25a805bd-2768-4d48-9bd0-52c3fe2c7f86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:42.139272 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25a805bd-2768-4d48-9bd0-52c3fe2c7f86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:42.139727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25a805bd-2768-4d48-9bd0-52c3fe2c7f86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:42.140153 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25a805bd-2768-4d48-9bd0-52c3fe2c7f86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:42.280449 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-25a805bd-2768-4d48-9bd0-52c3fe2c7f86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:42.289479 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-25a805bd-2768-4d48-9bd0-52c3fe2c7f86 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1690 microversion: 2.1 time: 0.162259 Sep 15 07:44:42.289479 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 360/709] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:42 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:42.336793 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:42.337549 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:42.344757 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:42.345257 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:42.345792 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:42.346499 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:42.346959 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:42.347531 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:42.501065 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:42.509245 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:42.510822 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:42.512146 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6383a8be-df69-46f8-9ca0-db2283cc9635 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1723 microversion: 2.20 time: 0.180225 Sep 15 07:44:42.512792 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 350/710] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:42 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:42.537012 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-dfb47b72-8f3b-4771-8a27-a4b8d81b0bba tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0c671e6-a980-47b6-85d9-22e798772fe1"}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:42.539449 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-dfb47b72-8f3b-4771-8a27-a4b8d81b0bba tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:42.546007 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb47b72-8f3b-4771-8a27-a4b8d81b0bba tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:42.546492 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb47b72-8f3b-4771-8a27-a4b8d81b0bba tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:42.546931 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb47b72-8f3b-4771-8a27-a4b8d81b0bba tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:42.547621 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb47b72-8f3b-4771-8a27-a4b8d81b0bba tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:42.548070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb47b72-8f3b-4771-8a27-a4b8d81b0bba tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:42.548490 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-dfb47b72-8f3b-4771-8a27-a4b8d81b0bba tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:43.313444 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c8bb8512-b02c-442b-926f-bd6aa8fec627 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:43.314558 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c8bb8512-b02c-442b-926f-bd6aa8fec627 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:43.321692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bb8512-b02c-442b-926f-bd6aa8fec627 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:43.327190 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bb8512-b02c-442b-926f-bd6aa8fec627 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:43.327190 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bb8512-b02c-442b-926f-bd6aa8fec627 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:43.327190 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bb8512-b02c-442b-926f-bd6aa8fec627 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:43.327190 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bb8512-b02c-442b-926f-bd6aa8fec627 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:43.327633 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8bb8512-b02c-442b-926f-bd6aa8fec627 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:43.356223 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-dfb47b72-8f3b-4771-8a27-a4b8d81b0bba tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "POST /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.822813 Sep 15 07:44:43.357790 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 361/711] 10.222.0.42 () {62 vars in 1364 bytes} [Thu Sep 15 07:44:42 2022] POST /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/os-volume_attachments => generated 188 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 07:44:43.391518 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c8bb8512-b02c-442b-926f-bd6aa8fec627 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:43.400208 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c8bb8512-b02c-442b-926f-bd6aa8fec627 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1623 microversion: 2.1 time: 0.092688 Sep 15 07:44:43.401378 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 351/712] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:43 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1623 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:44:43.435164 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-6a44d7e5-ef2f-43e5-a9a0-e71adabfdf06 req-a3d0f1c4-b554-4152-8678-c90538a62b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a3489f-c5f3-44d4-93c2-da198e8f06f8", "name": "network-vif-deleted", "tag": "5143816a-5379-4a8d-ad85-0a16d1348b1e"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:43.445878 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-6a44d7e5-ef2f-43e5-a9a0-e71adabfdf06 req-a3d0f1c4-b554-4152-8678-c90538a62b46 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:43.446376 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-6a44d7e5-ef2f-43e5-a9a0-e71adabfdf06 req-a3d0f1c4-b554-4152-8678-c90538a62b46 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:43.446803 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-6a44d7e5-ef2f-43e5-a9a0-e71adabfdf06 req-a3d0f1c4-b554-4152-8678-c90538a62b46 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:43.458290 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-6a44d7e5-ef2f-43e5-a9a0-e71adabfdf06 req-a3d0f1c4-b554-4152-8678-c90538a62b46 service nova] Creating event network-vif-deleted:5143816a-5379-4a8d-ad85-0a16d1348b1e for instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 on hv-cinder-82414 Sep 15 07:44:43.463149 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-6a44d7e5-ef2f-43e5-a9a0-e71adabfdf06 req-a3d0f1c4-b554-4152-8678-c90538a62b46 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032694 Sep 15 07:44:43.464929 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 362/713] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:44:43.499992 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bc8fd0bd-154e-467f-90d0-d6d1ed2076b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:43.500483 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bc8fd0bd-154e-467f-90d0-d6d1ed2076b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:43.506813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bc8fd0bd-154e-467f-90d0-d6d1ed2076b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:43.507334 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bc8fd0bd-154e-467f-90d0-d6d1ed2076b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:43.508053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bc8fd0bd-154e-467f-90d0-d6d1ed2076b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:43.508753 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bc8fd0bd-154e-467f-90d0-d6d1ed2076b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:43.509210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bc8fd0bd-154e-467f-90d0-d6d1ed2076b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:43.509697 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bc8fd0bd-154e-467f-90d0-d6d1ed2076b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:44.086930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bc8fd0bd-154e-467f-90d0-d6d1ed2076b7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/os-volume_attachments/c0c671e6-a980-47b6-85d9-22e798772fe1" status: 202 len: 0 microversion: 2.20 time: 0.591688 Sep 15 07:44:44.087663 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 352/714] 10.222.0.42 () {60 vars in 1457 bytes} [Thu Sep 15 07:44:43 2022] DELETE /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/os-volume_attachments/c0c671e6-a980-47b6-85d9-22e798772fe1 => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 07:44:44.156387 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-68dc0067-1eea-4139-b31b-176de1bdc2b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:44.157072 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-68dc0067-1eea-4139-b31b-176de1bdc2b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:44.163451 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68dc0067-1eea-4139-b31b-176de1bdc2b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:44.163942 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68dc0067-1eea-4139-b31b-176de1bdc2b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:44.164408 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68dc0067-1eea-4139-b31b-176de1bdc2b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:44.165110 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68dc0067-1eea-4139-b31b-176de1bdc2b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:44.165653 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68dc0067-1eea-4139-b31b-176de1bdc2b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:44.166029 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-68dc0067-1eea-4139-b31b-176de1bdc2b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:44.196326 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-68dc0067-1eea-4139-b31b-176de1bdc2b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132674) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 07:44:44.424372 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:44.424982 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:44.431425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:44.431912 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:44.432353 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:44.433050 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:44.434074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:44.434502 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:44.456151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-68dc0067-1eea-4139-b31b-176de1bdc2b1 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "POST /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/action" status: 202 len: 0 microversion: 2.20 time: 0.304877 Sep 15 07:44:44.457214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 363/715] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 15 07:44:44 2022] POST /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:44:44.465830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:44.466823 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:44.469881 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:44.470331 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:44.470756 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:44.471265 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lazy-loading 'fault' on Instance uuid 62a3489f-c5f3-44d4-93c2-da198e8f06f8 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:44:44.475319 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:44.477777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:44.477777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:44.477777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:44.477777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:44.478527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:44.519482 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:44.527641 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6004bf59-e8f9-4e7c-b256-19524e336730 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 200 len: 1336 microversion: 2.1 time: 0.107389 Sep 15 07:44:44.528227 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 353/716] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:44 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:44:44.630315 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:44.640121 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:44.641616 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:44.642977 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b614f852-0aca-48b8-b0fb-caafa8c585eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1671 microversion: 2.20 time: 0.181829 Sep 15 07:44:44.643534 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 364/717] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:44 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1671 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:45.550302 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:45.550962 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 62a3489f-c5f3-44d4-93c2-da198e8f06f8] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:45.557389 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:45.563877 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:45.563877 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:45.563877 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:45.563877 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:45.564385 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:45.573518 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] HTTP exception thrown: Instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 could not be found. Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Request method failure captured: Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 HTTP/1.1 Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItbY2L3ItdqVaB73YjwArZPr23BmX6ENHNLZJT2WdCDXyeVG5CK5pKWhEyleF5-RV2_raaWI0zXKOH-9Z9AH41lx9iUPkkpesBFRI5O9kzzv1YOcB8Wq1WkZItvtzmzZi5ZqhWF1QiKcU657CscGnDcQ5M8Dmr2TKDeM6OBUI71wxrM Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: cdc69db806d24d1f8eb18aadaaafabcb Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:44:45.575365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdc69db806d24d1f8eb18aadaaafabcb"}]}] Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: cdc69db806d24d1f8eb18aadaaafabcb Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-ServerRescueNegativeTestJSON-192071295-project Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 21de3a85b2df4af2833a24ab02f477c8 Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-ServerRescueNegativeTestJSON-192071295-project Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 could not be found. Sep 15 07:44:45.576984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '62a3489f-c5f3-44d4-93c2-da198e8f06f8'} Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 could not be found. Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:44:45.577979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 could not be found. Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 could not be found. Sep 15 07:44:45.579488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:44:45.580995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Returning 404 to user: Instance 62a3489f-c5f3-44d4-93c2-da198e8f06f8 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:44:45.580995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9bd7872d-6783-418f-930e-740cb6870d73 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8" status: 404 len: 111 microversion: 2.1 time: 0.030321 Sep 15 07:44:45.580995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 354/718] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:45 2022] GET /compute/v2.1/servers/62a3489f-c5f3-44d4-93c2-da198e8f06f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:44:45.585837 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3b86c0fc-cf46-49b9-8963-a981339ea2ca tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '.version_select at 0x7ff3701aa280>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:45.664489 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3b86c0fc-cf46-49b9-8963-a981339ea2ca tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939006037" status: 202 len: 0 microversion: 2.1 time: 0.082364 Sep 15 07:44:45.664995 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 365/719] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Sep 15 07:44:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939006037 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:44:45.669434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:45.670072 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:45.676307 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:45.677771 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:45.677771 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:45.677997 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:45.678370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:45.678792 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:45.830839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:45.839089 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:45.840847 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:45.842068 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b4ed3c69-9f23-4c57-93d3-b591baf00a1e tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1673 microversion: 2.20 time: 0.177629 Sep 15 07:44:45.842623 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 355/720] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:45 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:44:46.869463 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:46.870285 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:46.877300 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:46.877883 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:46.878316 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:46.879004 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:46.879451 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:46.881807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:47.016464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:47.025532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:47.027346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:47.028506 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d78269e5-d3b2-4025-a0f1-43db2950e5a5 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.164225 Sep 15 07:44:47.029109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 366/721] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:46 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:48.057210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:48.058712 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:48.067930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:48.068804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:48.069482 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:48.070449 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:48.071598 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:48.072261 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:48.219927 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:48.229761 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:48.231745 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:48.233142 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-10e3eeae-af6d-4549-aa01-ac176318f997 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.180961 Sep 15 07:44:48.233816 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 356/722] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:48 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:44:48.991665 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6d2cf5d5-a3e8-41be-8a77-bb977089dc52 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:48.992216 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6d2cf5d5-a3e8-41be-8a77-bb977089dc52 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:48.999474 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d2cf5d5-a3e8-41be-8a77-bb977089dc52 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:48.999970 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d2cf5d5-a3e8-41be-8a77-bb977089dc52 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:49.000430 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d2cf5d5-a3e8-41be-8a77-bb977089dc52 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:49.001126 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d2cf5d5-a3e8-41be-8a77-bb977089dc52 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:49.001603 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d2cf5d5-a3e8-41be-8a77-bb977089dc52 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:49.002027 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d2cf5d5-a3e8-41be-8a77-bb977089dc52 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:49.028315 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6d2cf5d5-a3e8-41be-8a77-bb977089dc52 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:44:49.239932 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6d2cf5d5-a3e8-41be-8a77-bb977089dc52 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "DELETE /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 204 len: 0 microversion: 2.1 time: 0.251654 Sep 15 07:44:49.240427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 367/723] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:44:48 2022] DELETE /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:44:49.249226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-22a3bed8-4b6b-45aa-a3b5-eda9025bae09 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:49.249856 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-22a3bed8-4b6b-45aa-a3b5-eda9025bae09 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:49.256329 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22a3bed8-4b6b-45aa-a3b5-eda9025bae09 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:49.256813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22a3bed8-4b6b-45aa-a3b5-eda9025bae09 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:49.257248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22a3bed8-4b6b-45aa-a3b5-eda9025bae09 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:49.257968 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22a3bed8-4b6b-45aa-a3b5-eda9025bae09 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:49.258419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22a3bed8-4b6b-45aa-a3b5-eda9025bae09 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:49.258942 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22a3bed8-4b6b-45aa-a3b5-eda9025bae09 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:49.261169 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:49.261939 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:49.270421 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:49.271236 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:49.271798 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:49.273393 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:49.274057 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:49.274735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:49.486761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:49.489100 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-22a3bed8-4b6b-45aa-a3b5-eda9025bae09 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:49.496386 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:49.497844 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:49.498866 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-22a3bed8-4b6b-45aa-a3b5-eda9025bae09 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1508 microversion: 2.1 time: 0.253951 Sep 15 07:44:49.498992 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a0621771-32e6-474b-a06a-9930903e2b02 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.242587 Sep 15 07:44:49.499798 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 368/724] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:49 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:44:49.509209 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 357/725] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:49 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:50.523138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1352e49c-e813-4d3e-81ff-476a8e313bc7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:50.523989 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1352e49c-e813-4d3e-81ff-476a8e313bc7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:50.524785 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:50.525496 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:50.533662 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:50.539266 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:50.539266 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:50.539266 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:50.539266 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:50.539630 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:50.539708 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1352e49c-e813-4d3e-81ff-476a8e313bc7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:50.539996 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1352e49c-e813-4d3e-81ff-476a8e313bc7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:50.540443 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1352e49c-e813-4d3e-81ff-476a8e313bc7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:50.541142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1352e49c-e813-4d3e-81ff-476a8e313bc7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:50.541877 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1352e49c-e813-4d3e-81ff-476a8e313bc7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:50.542339 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1352e49c-e813-4d3e-81ff-476a8e313bc7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:50.552616 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:50.772383 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1352e49c-e813-4d3e-81ff-476a8e313bc7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:50.780595 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:50.782001 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1352e49c-e813-4d3e-81ff-476a8e313bc7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1508 microversion: 2.1 time: 0.263066 Sep 15 07:44:50.785024 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 369/726] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:50 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1508 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:50.795163 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:50.796630 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:50.798590 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-76ba363f-cf3a-4e6a-9ca2-5ae8887035e0 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.277627 Sep 15 07:44:50.799342 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 358/727] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:50 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:44:51.809071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-245697ad-a0dc-46ff-8cd0-9eda4a3511e9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:51.809720 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-245697ad-a0dc-46ff-8cd0-9eda4a3511e9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:51.817295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-245697ad-a0dc-46ff-8cd0-9eda4a3511e9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:51.817904 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-245697ad-a0dc-46ff-8cd0-9eda4a3511e9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:51.818371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-245697ad-a0dc-46ff-8cd0-9eda4a3511e9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:51.819181 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-245697ad-a0dc-46ff-8cd0-9eda4a3511e9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:51.819701 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-245697ad-a0dc-46ff-8cd0-9eda4a3511e9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:51.820106 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-245697ad-a0dc-46ff-8cd0-9eda4a3511e9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:51.825753 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:51.826369 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:51.832641 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:51.833128 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:51.833569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:51.834290 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:51.834748 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:51.835177 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:52.045236 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-245697ad-a0dc-46ff-8cd0-9eda4a3511e9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:52.053802 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:52.056266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-245697ad-a0dc-46ff-8cd0-9eda4a3511e9 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1508 microversion: 2.1 time: 0.251677 Sep 15 07:44:52.057090 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 370/728] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:51 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:52.061931 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d96014e8-00d5-4d1d-b1ed-10e2bf36eaaf tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:52.062660 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d96014e8-00d5-4d1d-b1ed-10e2bf36eaaf tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:52.062839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:52.064419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:52.065704 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a666057e-2651-4ce3-bd27-aec6366a9438 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.244754 Sep 15 07:44:52.066341 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 359/729] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:51 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:44:52.074202 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d96014e8-00d5-4d1d-b1ed-10e2bf36eaaf tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:52.074847 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d96014e8-00d5-4d1d-b1ed-10e2bf36eaaf tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:52.075393 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d96014e8-00d5-4d1d-b1ed-10e2bf36eaaf tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:52.076207 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d96014e8-00d5-4d1d-b1ed-10e2bf36eaaf tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:52.076935 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d96014e8-00d5-4d1d-b1ed-10e2bf36eaaf tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:52.077470 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d96014e8-00d5-4d1d-b1ed-10e2bf36eaaf tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:52.107184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d96014e8-00d5-4d1d-b1ed-10e2bf36eaaf tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:44:52.960459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ae5788a0-9f40-4d05-9dc6-57e8392846ce tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:52.961691 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ae5788a0-9f40-4d05-9dc6-57e8392846ce tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:52.970885 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae5788a0-9f40-4d05-9dc6-57e8392846ce tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:52.971382 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae5788a0-9f40-4d05-9dc6-57e8392846ce tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:52.971816 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae5788a0-9f40-4d05-9dc6-57e8392846ce tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:52.972522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae5788a0-9f40-4d05-9dc6-57e8392846ce tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:52.972975 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae5788a0-9f40-4d05-9dc6-57e8392846ce tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:52.973400 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae5788a0-9f40-4d05-9dc6-57e8392846ce tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:53.008205 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ae5788a0-9f40-4d05-9dc6-57e8392846ce tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/ips" status: 200 len: 149 microversion: 2.1 time: 0.062986 Sep 15 07:44:53.009200 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 360/730] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 15 07:44:52 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/ips => generated 149 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:44:53.093473 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-11b90883-536a-437c-87d3-581a1055b2ae tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:53.094151 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-11b90883-536a-437c-87d3-581a1055b2ae tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:53.100006 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11b90883-536a-437c-87d3-581a1055b2ae tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:53.101636 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11b90883-536a-437c-87d3-581a1055b2ae tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:53.101636 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11b90883-536a-437c-87d3-581a1055b2ae tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:53.101636 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11b90883-536a-437c-87d3-581a1055b2ae tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:53.102138 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11b90883-536a-437c-87d3-581a1055b2ae tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:53.102511 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11b90883-536a-437c-87d3-581a1055b2ae tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:53.200749 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d96014e8-00d5-4d1d-b1ed-10e2bf36eaaf tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 204 len: 0 microversion: 2.1 time: 1.141576 Sep 15 07:44:53.241711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 371/731] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:44:52 2022] DELETE /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 0 bytes in 1144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:44:53.241711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:53.241711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:53.241711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:53.242661 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:53.242661 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:53.242661 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:53.242661 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:53.242952 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:53.312948 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-11b90883-536a-437c-87d3-581a1055b2ae tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:53.320994 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-11b90883-536a-437c-87d3-581a1055b2ae tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1508 microversion: 2.1 time: 0.232031 Sep 15 07:44:53.321657 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 361/732] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:53 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:44:53.344321 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-dc4108ae-8f46-4ba5-8c67-6387b7d19adb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:53.345060 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-dc4108ae-8f46-4ba5-8c67-6387b7d19adb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:53.351517 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dc4108ae-8f46-4ba5-8c67-6387b7d19adb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:53.352289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dc4108ae-8f46-4ba5-8c67-6387b7d19adb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:53.352789 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dc4108ae-8f46-4ba5-8c67-6387b7d19adb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:53.354379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dc4108ae-8f46-4ba5-8c67-6387b7d19adb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:53.355015 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dc4108ae-8f46-4ba5-8c67-6387b7d19adb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:53.355520 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-dc4108ae-8f46-4ba5-8c67-6387b7d19adb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:53.393318 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:53.465488 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:53.475482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:53.477406 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:53.479417 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-60899ff2-0946-480e-aa52-9237fc87e9de tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.275973 Sep 15 07:44:53.491627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 372/733] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:53 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:53.563049 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-dc4108ae-8f46-4ba5-8c67-6387b7d19adb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:53.571485 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-dc4108ae-8f46-4ba5-8c67-6387b7d19adb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1576 microversion: 2.1 time: 0.236677 Sep 15 07:44:53.573421 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 362/734] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:53 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1576 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:54.352219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bd7c2dbc-2ab9-42c5-8708-522952cb53f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:54.353042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bd7c2dbc-2ab9-42c5-8708-522952cb53f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:54.360138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd7c2dbc-2ab9-42c5-8708-522952cb53f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:54.360631 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd7c2dbc-2ab9-42c5-8708-522952cb53f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:54.361073 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd7c2dbc-2ab9-42c5-8708-522952cb53f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:54.361807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd7c2dbc-2ab9-42c5-8708-522952cb53f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:54.362266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd7c2dbc-2ab9-42c5-8708-522952cb53f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:54.362692 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd7c2dbc-2ab9-42c5-8708-522952cb53f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:54.505636 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bd7c2dbc-2ab9-42c5-8708-522952cb53f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:54.507550 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:54.508283 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:54.514351 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bd7c2dbc-2ab9-42c5-8708-522952cb53f1 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1508 microversion: 2.1 time: 0.167405 Sep 15 07:44:54.514932 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 373/735] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:54 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:54.525681 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:54.526952 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:54.527402 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:54.528149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:54.528612 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:54.529047 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:54.598383 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9394ac4b-0391-422c-9f75-437837a66aa8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:54.599009 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9394ac4b-0391-422c-9f75-437837a66aa8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:54.621816 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9394ac4b-0391-422c-9f75-437837a66aa8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:54.621816 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9394ac4b-0391-422c-9f75-437837a66aa8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:54.621816 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9394ac4b-0391-422c-9f75-437837a66aa8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:54.622698 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9394ac4b-0391-422c-9f75-437837a66aa8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:54.623191 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9394ac4b-0391-422c-9f75-437837a66aa8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:54.629693 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9394ac4b-0391-422c-9f75-437837a66aa8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:54.766378 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:54.777384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:54.778531 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:54.779897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7f57e221-d889-41cc-ac63-b99cb229bbdc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.276624 Sep 15 07:44:54.780753 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 363/736] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:54 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:44:54.828837 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9394ac4b-0391-422c-9f75-437837a66aa8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:54.840205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9394ac4b-0391-422c-9f75-437837a66aa8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1576 microversion: 2.1 time: 0.244439 Sep 15 07:44:54.840205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 374/737] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:54 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:44:54.883902 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-cd8e5bef-d154-4c21-a121-27cc623f5d8a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e21756b-b571-471f-b760-0f0dbf7dab4f"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:54.887065 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-cd8e5bef-d154-4c21-a121-27cc623f5d8a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:54.893072 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd8e5bef-d154-4c21-a121-27cc623f5d8a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:54.893556 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd8e5bef-d154-4c21-a121-27cc623f5d8a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:54.894037 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd8e5bef-d154-4c21-a121-27cc623f5d8a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:54.894722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd8e5bef-d154-4c21-a121-27cc623f5d8a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:54.895173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd8e5bef-d154-4c21-a121-27cc623f5d8a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:54.895595 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cd8e5bef-d154-4c21-a121-27cc623f5d8a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:55.538104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-94f2ee19-decd-4f49-9f52-2c8b08a93173 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:55.538748 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-94f2ee19-decd-4f49-9f52-2c8b08a93173 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:55.545271 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-94f2ee19-decd-4f49-9f52-2c8b08a93173 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:55.545789 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-94f2ee19-decd-4f49-9f52-2c8b08a93173 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:55.546223 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-94f2ee19-decd-4f49-9f52-2c8b08a93173 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:55.547124 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-94f2ee19-decd-4f49-9f52-2c8b08a93173 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:55.547578 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-94f2ee19-decd-4f49-9f52-2c8b08a93173 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:55.547999 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-94f2ee19-decd-4f49-9f52-2c8b08a93173 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:55.692854 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-94f2ee19-decd-4f49-9f52-2c8b08a93173 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:55.704608 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-94f2ee19-decd-4f49-9f52-2c8b08a93173 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1508 microversion: 2.1 time: 0.169725 Sep 15 07:44:55.705473 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 375/738] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:55 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:44:55.710240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9fb92cfe-9b64-4c92-b204-8427e6687b18 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:44:55.710793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9fb92cfe-9b64-4c92-b204-8427e6687b18 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:55.718388 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fb92cfe-9b64-4c92-b204-8427e6687b18 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:55.718925 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fb92cfe-9b64-4c92-b204-8427e6687b18 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:55.719424 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fb92cfe-9b64-4c92-b204-8427e6687b18 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:55.720139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fb92cfe-9b64-4c92-b204-8427e6687b18 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:55.720585 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fb92cfe-9b64-4c92-b204-8427e6687b18 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:55.721071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fb92cfe-9b64-4c92-b204-8427e6687b18 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:55.745511 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-9fb92cfe-9b64-4c92-b204-8427e6687b18 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lazy-loading 'flavor' on Instance uuid 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:44:56.032008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9fb92cfe-9b64-4c92-b204-8427e6687b18 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "POST /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e/action" status: 202 len: 0 microversion: 2.1 time: 0.324922 Sep 15 07:44:56.032424 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 376/739] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:44:55 2022] POST /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:44:56.037743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:56.038441 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:56.044748 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:56.049073 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:56.049073 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:56.049073 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:56.049073 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:56.049451 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:56.187047 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:56.195218 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:56.197489 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:56.200611 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a3398767-8854-454f-9ff9-d3efb2b2b9eb tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.166173 Sep 15 07:44:56.201225 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 377/740] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:56 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:44:56.207002 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d33a347f-b2a6-451b-8fa1-971ccbd7f404 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:56.209522 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d33a347f-b2a6-451b-8fa1-971ccbd7f404 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:56.216058 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d33a347f-b2a6-451b-8fa1-971ccbd7f404 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:56.216549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d33a347f-b2a6-451b-8fa1-971ccbd7f404 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:56.216985 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d33a347f-b2a6-451b-8fa1-971ccbd7f404 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:56.217706 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d33a347f-b2a6-451b-8fa1-971ccbd7f404 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:56.218159 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d33a347f-b2a6-451b-8fa1-971ccbd7f404 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:56.218677 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d33a347f-b2a6-451b-8fa1-971ccbd7f404 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:56.353242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d33a347f-b2a6-451b-8fa1-971ccbd7f404 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:56.360997 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d33a347f-b2a6-451b-8fa1-971ccbd7f404 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1576 microversion: 2.1 time: 0.158780 Sep 15 07:44:56.361560 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 378/741] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:56 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:56.365886 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f8748813-7a32-4279-b98f-5c9d2afc020d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:56.366761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f8748813-7a32-4279-b98f-5c9d2afc020d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:56.372129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8748813-7a32-4279-b98f-5c9d2afc020d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:56.372607 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8748813-7a32-4279-b98f-5c9d2afc020d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:56.373037 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8748813-7a32-4279-b98f-5c9d2afc020d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:56.373741 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8748813-7a32-4279-b98f-5c9d2afc020d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:56.374188 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8748813-7a32-4279-b98f-5c9d2afc020d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:56.374603 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8748813-7a32-4279-b98f-5c9d2afc020d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:56.508325 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f8748813-7a32-4279-b98f-5c9d2afc020d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:56.516393 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f8748813-7a32-4279-b98f-5c9d2afc020d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.153846 Sep 15 07:44:56.516948 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 379/742] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:56 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:56.728516 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e14e3016-d09f-4b96-8d31-4ab9c256a77d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:56.729141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e14e3016-d09f-4b96-8d31-4ab9c256a77d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:56.735702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e14e3016-d09f-4b96-8d31-4ab9c256a77d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:56.736183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e14e3016-d09f-4b96-8d31-4ab9c256a77d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:56.736619 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e14e3016-d09f-4b96-8d31-4ab9c256a77d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:56.737308 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e14e3016-d09f-4b96-8d31-4ab9c256a77d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:56.737790 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e14e3016-d09f-4b96-8d31-4ab9c256a77d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:56.738215 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e14e3016-d09f-4b96-8d31-4ab9c256a77d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:56.869114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e14e3016-d09f-4b96-8d31-4ab9c256a77d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:56.877828 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e14e3016-d09f-4b96-8d31-4ab9c256a77d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1508 microversion: 2.1 time: 0.153473 Sep 15 07:44:56.878385 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 380/743] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:56 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:44:57.227131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:57.237983 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:57.237983 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:57.237983 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:57.237983 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:57.238500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:57.239031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:57.239506 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:57.368203 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:57.376345 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:57.377872 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:57.379057 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2c037ea3-3d6f-4165-b0ff-1c5a30e8e97d tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.155883 Sep 15 07:44:57.379612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 381/744] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:57 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:44:57.384509 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2f14a0f6-c634-4ba1-af88-501f77799621 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:57.385905 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2f14a0f6-c634-4ba1-af88-501f77799621 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:57.390962 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2f14a0f6-c634-4ba1-af88-501f77799621 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:57.391450 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2f14a0f6-c634-4ba1-af88-501f77799621 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:57.391893 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2f14a0f6-c634-4ba1-af88-501f77799621 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:57.392583 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2f14a0f6-c634-4ba1-af88-501f77799621 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:57.393040 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2f14a0f6-c634-4ba1-af88-501f77799621 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:57.393474 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2f14a0f6-c634-4ba1-af88-501f77799621 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:57.397958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:57.525963 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2f14a0f6-c634-4ba1-af88-501f77799621 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:57.533653 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2f14a0f6-c634-4ba1-af88-501f77799621 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1576 microversion: 2.1 time: 0.153071 Sep 15 07:44:57.534223 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 382/745] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:57 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:57.539601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f1127a94-3370-4b26-a2e5-40d434eb8afc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:57.546600 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f1127a94-3370-4b26-a2e5-40d434eb8afc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:57.546600 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1127a94-3370-4b26-a2e5-40d434eb8afc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:57.547098 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1127a94-3370-4b26-a2e5-40d434eb8afc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:57.547537 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1127a94-3370-4b26-a2e5-40d434eb8afc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:57.548228 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1127a94-3370-4b26-a2e5-40d434eb8afc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:57.548685 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1127a94-3370-4b26-a2e5-40d434eb8afc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:57.549114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1127a94-3370-4b26-a2e5-40d434eb8afc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:57.689259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f1127a94-3370-4b26-a2e5-40d434eb8afc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:57.698135 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f1127a94-3370-4b26-a2e5-40d434eb8afc tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.161996 Sep 15 07:44:57.698927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 383/746] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:57 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:44:57.900496 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f36e10c3-82ed-4b43-98d1-d5e14882c472 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:57.901114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f36e10c3-82ed-4b43-98d1-d5e14882c472 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:57.907533 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f36e10c3-82ed-4b43-98d1-d5e14882c472 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:57.908011 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f36e10c3-82ed-4b43-98d1-d5e14882c472 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:57.908444 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f36e10c3-82ed-4b43-98d1-d5e14882c472 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:57.909126 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f36e10c3-82ed-4b43-98d1-d5e14882c472 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:57.909571 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f36e10c3-82ed-4b43-98d1-d5e14882c472 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:57.910048 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f36e10c3-82ed-4b43-98d1-d5e14882c472 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:58.039897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f36e10c3-82ed-4b43-98d1-d5e14882c472 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:58.047779 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f36e10c3-82ed-4b43-98d1-d5e14882c472 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1508 microversion: 2.1 time: 0.151286 Sep 15 07:44:58.048339 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 384/747] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:57 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:44:58.405457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:58.406103 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:58.412074 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:58.412556 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:58.412998 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:58.413717 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:58.414172 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:58.415159 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:58.557171 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:58.565064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:58.566511 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:58.567657 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bd53fc8d-cca1-4cd8-9893-5dce0ed526e3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.166121 Sep 15 07:44:58.568207 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 385/748] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:58 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:44:58.573357 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6aa522f9-3d45-4992-94b5-6755f7b292df tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:58.573990 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6aa522f9-3d45-4992-94b5-6755f7b292df tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:58.576557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:44:58.579775 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6aa522f9-3d45-4992-94b5-6755f7b292df tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:58.580254 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6aa522f9-3d45-4992-94b5-6755f7b292df tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:58.580743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6aa522f9-3d45-4992-94b5-6755f7b292df tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:58.581429 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6aa522f9-3d45-4992-94b5-6755f7b292df tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:58.581906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6aa522f9-3d45-4992-94b5-6755f7b292df tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:58.582329 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6aa522f9-3d45-4992-94b5-6755f7b292df tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:58.720391 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6aa522f9-3d45-4992-94b5-6755f7b292df tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:58.728306 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6aa522f9-3d45-4992-94b5-6755f7b292df tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1576 microversion: 2.1 time: 0.159133 Sep 15 07:44:58.728880 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 386/749] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:58 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:58.733247 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5d785f67-1811-4941-b2aa-335e3cea4693 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:58.733885 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5d785f67-1811-4941-b2aa-335e3cea4693 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:58.739979 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d785f67-1811-4941-b2aa-335e3cea4693 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:58.740472 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d785f67-1811-4941-b2aa-335e3cea4693 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:58.740912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d785f67-1811-4941-b2aa-335e3cea4693 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:58.741896 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d785f67-1811-4941-b2aa-335e3cea4693 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:58.742353 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d785f67-1811-4941-b2aa-335e3cea4693 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:58.743470 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5d785f67-1811-4941-b2aa-335e3cea4693 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:58.880732 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5d785f67-1811-4941-b2aa-335e3cea4693 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:58.887837 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5d785f67-1811-4941-b2aa-335e3cea4693 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.157993 Sep 15 07:44:58.888408 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 387/750] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:58 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:59.071225 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f61fce4e-2bb6-4616-b849-3bf761c21563 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:59.071888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f61fce4e-2bb6-4616-b849-3bf761c21563 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:59.078246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f61fce4e-2bb6-4616-b849-3bf761c21563 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:59.078719 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f61fce4e-2bb6-4616-b849-3bf761c21563 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:59.079150 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f61fce4e-2bb6-4616-b849-3bf761c21563 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:59.079831 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f61fce4e-2bb6-4616-b849-3bf761c21563 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:59.080280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f61fce4e-2bb6-4616-b849-3bf761c21563 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:59.080699 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f61fce4e-2bb6-4616-b849-3bf761c21563 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:59.210668 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f61fce4e-2bb6-4616-b849-3bf761c21563 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:59.218313 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f61fce4e-2bb6-4616-b849-3bf761c21563 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1508 microversion: 2.1 time: 0.150961 Sep 15 07:44:59.219079 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 388/751] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:59 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:44:59.594132 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:59.594772 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:59.600624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:59.601101 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:59.601534 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:59.602256 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:59.603375 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:59.603909 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:59.731420 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:59.739339 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:59.740783 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:59.742279 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0893b51b-cb02-45a2-8e5e-a83fce87232c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.152023 Sep 15 07:44:59.742848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 389/752] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:44:59 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:44:59.751670 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5158b0f3-aeb8-4adb-ae0a-43ee2bc87c11 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:59.752306 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5158b0f3-aeb8-4adb-ae0a-43ee2bc87c11 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:59.757858 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5158b0f3-aeb8-4adb-ae0a-43ee2bc87c11 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:59.758338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5158b0f3-aeb8-4adb-ae0a-43ee2bc87c11 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:59.759477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5158b0f3-aeb8-4adb-ae0a-43ee2bc87c11 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:59.760377 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5158b0f3-aeb8-4adb-ae0a-43ee2bc87c11 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:59.760830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5158b0f3-aeb8-4adb-ae0a-43ee2bc87c11 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:59.761258 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5158b0f3-aeb8-4adb-ae0a-43ee2bc87c11 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:59.892175 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5158b0f3-aeb8-4adb-ae0a-43ee2bc87c11 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:44:59.900834 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5158b0f3-aeb8-4adb-ae0a-43ee2bc87c11 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1576 microversion: 2.1 time: 0.152384 Sep 15 07:44:59.901413 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 390/753] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:59 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:44:59.911256 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-8fb6c850-6863-4640-88f8-08b88274b140 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:44:59.911857 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-8fb6c850-6863-4640-88f8-08b88274b140 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:44:59.917861 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8fb6c850-6863-4640-88f8-08b88274b140 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:59.918371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8fb6c850-6863-4640-88f8-08b88274b140 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:59.918801 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8fb6c850-6863-4640-88f8-08b88274b140 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:44:59.919511 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8fb6c850-6863-4640-88f8-08b88274b140 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:44:59.919957 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8fb6c850-6863-4640-88f8-08b88274b140 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:44:59.920375 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8fb6c850-6863-4640-88f8-08b88274b140 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:00.052196 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8fb6c850-6863-4640-88f8-08b88274b140 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:00.061113 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-8fb6c850-6863-4640-88f8-08b88274b140 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.153616 Sep 15 07:45:00.061696 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 391/754] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:44:59 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:00.241321 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-20b1ceb2-f772-4aeb-aaa1-edf9e0d61403 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:00.243240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-20b1ceb2-f772-4aeb-aaa1-edf9e0d61403 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:00.249270 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-20b1ceb2-f772-4aeb-aaa1-edf9e0d61403 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:00.249791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-20b1ceb2-f772-4aeb-aaa1-edf9e0d61403 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:00.250235 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-20b1ceb2-f772-4aeb-aaa1-edf9e0d61403 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:00.250927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-20b1ceb2-f772-4aeb-aaa1-edf9e0d61403 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:00.251384 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-20b1ceb2-f772-4aeb-aaa1-edf9e0d61403 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:00.251813 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-20b1ceb2-f772-4aeb-aaa1-edf9e0d61403 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:00.497163 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-20b1ceb2-f772-4aeb-aaa1-edf9e0d61403 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:00.506125 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-20b1ceb2-f772-4aeb-aaa1-edf9e0d61403 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1508 microversion: 2.1 time: 0.268880 Sep 15 07:45:00.516809 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 392/755] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:00 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:00.618529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-cd8e5bef-d154-4c21-a121-27cc623f5d8a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "POST /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.728778 Sep 15 07:45:00.618529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 364/756] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:44:54 2022] POST /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/os-volume_attachments => generated 194 bytes in 5731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:45:00.768058 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:00.768671 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:00.777137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:00.781777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:00.781777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:00.781777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:00.781777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:00.782227 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:00.920241 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-93a84afd-6af9-4058-b09e-521a23b5132d req-b06f83f7-33f2-437c-b95c-c57f3f01080d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81bf969c-3300-4003-9606-ea44bac82330", "name": "network-vif-deleted", "tag": "c255aeb9-c056-475b-98ed-85ece1d8c073"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:00.937613 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-93a84afd-6af9-4058-b09e-521a23b5132d req-b06f83f7-33f2-437c-b95c-c57f3f01080d service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:00.942180 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-93a84afd-6af9-4058-b09e-521a23b5132d req-b06f83f7-33f2-437c-b95c-c57f3f01080d service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:00.944251 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-93a84afd-6af9-4058-b09e-521a23b5132d req-b06f83f7-33f2-437c-b95c-c57f3f01080d service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:00.967129 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-93a84afd-6af9-4058-b09e-521a23b5132d req-b06f83f7-33f2-437c-b95c-c57f3f01080d service nova] Creating event network-vif-deleted:c255aeb9-c056-475b-98ed-85ece1d8c073 for instance 81bf969c-3300-4003-9606-ea44bac82330 on hv-cinder-82414 Sep 15 07:45:00.972161 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-93a84afd-6af9-4058-b09e-521a23b5132d req-b06f83f7-33f2-437c-b95c-c57f3f01080d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060460 Sep 15 07:45:00.973047 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 365/757] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:45:00.979486 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3ef28213-c47b-4ae6-97d4-2994cdc94775 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:00.980488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3ef28213-c47b-4ae6-97d4-2994cdc94775 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:01.001142 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ef28213-c47b-4ae6-97d4-2994cdc94775 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:01.002286 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ef28213-c47b-4ae6-97d4-2994cdc94775 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:01.003162 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ef28213-c47b-4ae6-97d4-2994cdc94775 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:01.004107 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ef28213-c47b-4ae6-97d4-2994cdc94775 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:01.004720 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ef28213-c47b-4ae6-97d4-2994cdc94775 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:01.005686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3ef28213-c47b-4ae6-97d4-2994cdc94775 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:01.460654 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:01.471167 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:01.475020 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:01.476108 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0465de4d-ea37-4afd-9c5c-0616203f6d66 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.711369 Sep 15 07:45:01.476205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 393/758] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:00 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:45:01.493074 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-8c666fe2-2c82-40c0-83df-883230b4dd13 req-6880b3d7-6570-47f2-88a3-a616f388cfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f14c845-5f86-4d74-8813-e7c482a6be08", "name": "network-vif-plugged", "status": "completed", "tag": "2f98d201-6410-4508-a7f3-40ecd7daed4f"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:01.503959 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-8c666fe2-2c82-40c0-83df-883230b4dd13 req-6880b3d7-6570-47f2-88a3-a616f388cfe2 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:01.503959 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-8c666fe2-2c82-40c0-83df-883230b4dd13 req-6880b3d7-6570-47f2-88a3-a616f388cfe2 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:01.504173 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-8c666fe2-2c82-40c0-83df-883230b4dd13 req-6880b3d7-6570-47f2-88a3-a616f388cfe2 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:01.521005 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-8c666fe2-2c82-40c0-83df-883230b4dd13 req-6880b3d7-6570-47f2-88a3-a616f388cfe2 service nova] Creating event network-vif-plugged:2f98d201-6410-4508-a7f3-40ecd7daed4f for instance 0f14c845-5f86-4d74-8813-e7c482a6be08 on hv-cinder-82414 Sep 15 07:45:01.528356 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-8c666fe2-2c82-40c0-83df-883230b4dd13 req-6880b3d7-6570-47f2-88a3-a616f388cfe2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039107 Sep 15 07:45:01.529095 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 394/759] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:45:01.537087 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ddbc0ce0-b9e6-461f-80e2-4f16c657125b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:01.538041 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ddbc0ce0-b9e6-461f-80e2-4f16c657125b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:01.544600 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ddbc0ce0-b9e6-461f-80e2-4f16c657125b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:01.545077 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ddbc0ce0-b9e6-461f-80e2-4f16c657125b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:01.545506 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ddbc0ce0-b9e6-461f-80e2-4f16c657125b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:01.546462 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ddbc0ce0-b9e6-461f-80e2-4f16c657125b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:01.547071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ddbc0ce0-b9e6-461f-80e2-4f16c657125b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:01.547669 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ddbc0ce0-b9e6-461f-80e2-4f16c657125b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:01.628651 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3ef28213-c47b-4ae6-97d4-2994cdc94775 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:01.637153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3ef28213-c47b-4ae6-97d4-2994cdc94775 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1576 microversion: 2.1 time: 0.662788 Sep 15 07:45:01.637963 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 366/760] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:00 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1576 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:01.642406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:01.645746 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:01.648864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:01.649719 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:01.650159 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:01.650858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:01.651309 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:01.651733 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:01.685558 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:01.686142 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:01.686576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:01.687024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lazy-loading 'fault' on Instance uuid 81bf969c-3300-4003-9606-ea44bac82330 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:45:01.782431 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:01.809602 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6eaf329e-f73f-4161-b8fa-51d05013684f tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 200 len: 1311 microversion: 2.1 time: 0.170455 Sep 15 07:45:01.815890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 367/761] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:01 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 1311 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:01.844351 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ddbc0ce0-b9e6-461f-80e2-4f16c657125b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:01.853148 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ddbc0ce0-b9e6-461f-80e2-4f16c657125b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.319280 Sep 15 07:45:01.853861 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 395/762] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:01 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:02.296850 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-2ecf11a9-dd59-414a-b678-f6f0b0b3a488 req-fc98533c-833b-43df-9f9a-be4a8e0c99cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfb1a22-faac-4d66-874d-e7866a02a054", "name": "network-vif-deleted", "tag": "64d3dfe8-cb43-42b9-b820-a5af2429b050"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:02.307294 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-2ecf11a9-dd59-414a-b678-f6f0b0b3a488 req-fc98533c-833b-43df-9f9a-be4a8e0c99cf service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:02.307776 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-2ecf11a9-dd59-414a-b678-f6f0b0b3a488 req-fc98533c-833b-43df-9f9a-be4a8e0c99cf service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:02.308212 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-2ecf11a9-dd59-414a-b678-f6f0b0b3a488 req-fc98533c-833b-43df-9f9a-be4a8e0c99cf service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:02.319791 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-2ecf11a9-dd59-414a-b678-f6f0b0b3a488 req-fc98533c-833b-43df-9f9a-be4a8e0c99cf service nova] Creating event network-vif-deleted:64d3dfe8-cb43-42b9-b820-a5af2429b050 for instance 7cfb1a22-faac-4d66-874d-e7866a02a054 on hv-cinder-82414 Sep 15 07:45:02.325904 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-2ecf11a9-dd59-414a-b678-f6f0b0b3a488 req-fc98533c-833b-43df-9f9a-be4a8e0c99cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032589 Sep 15 07:45:02.326512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 368/763] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:45:02.507374 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:02.508821 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:02.516930 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:02.516930 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:02.516930 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:02.517459 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:02.517938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:02.518357 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:02.657695 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:02.667007 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:02.668743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:02.671566 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d75e52cb-8e95-4364-82c5-063ca3eb2b91 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.167842 Sep 15 07:45:02.673007 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-fbceb101-8613-4d0c-83e5-d6d2e4474d9c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:02.675435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-fbceb101-8613-4d0c-83e5-d6d2e4474d9c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:02.685642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 396/764] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:02 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:45:02.687129 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fbceb101-8613-4d0c-83e5-d6d2e4474d9c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:02.688672 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fbceb101-8613-4d0c-83e5-d6d2e4474d9c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:02.689606 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fbceb101-8613-4d0c-83e5-d6d2e4474d9c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:02.690704 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fbceb101-8613-4d0c-83e5-d6d2e4474d9c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:02.691404 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fbceb101-8613-4d0c-83e5-d6d2e4474d9c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:02.692065 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fbceb101-8613-4d0c-83e5-d6d2e4474d9c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:02.756692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fbceb101-8613-4d0c-83e5-d6d2e4474d9c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:02.765460 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-fbceb101-8613-4d0c-83e5-d6d2e4474d9c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1225 microversion: 2.1 time: 0.104026 Sep 15 07:45:02.766077 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 369/765] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:02 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:02.844179 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:02.844943 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 81bf969c-3300-4003-9606-ea44bac82330] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:02.850958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:02.851444 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:02.851882 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:02.853391 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:02.853888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:02.854323 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:02.868432 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] HTTP exception thrown: Instance 81bf969c-3300-4003-9606-ea44bac82330 could not be found. Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Request method failure captured: Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 HTTP/1.1 Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItbY2L3ItdqVaB73YjwArZPr23BmX6ENHNLZJT2WdCDXyeVG5CK5pKWhEyleF5-RV2_raaWI0zXKOH-9Z9AH41lx9iUPkkpesBFRI5O9kzzv1YOcB8Wq1WkZItvtzmzZi5ZqhWF1QiKcU657CscGnDcQ5M8Dmr2TKDeM6OBUI71wxrM Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: cdc69db806d24d1f8eb18aadaaafabcb Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:45:02.870141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdc69db806d24d1f8eb18aadaaafabcb"}]}] Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: cdc69db806d24d1f8eb18aadaaafabcb Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-ServerRescueNegativeTestJSON-192071295-project Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 21de3a85b2df4af2833a24ab02f477c8 Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-ServerRescueNegativeTestJSON-192071295-project Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 81bf969c-3300-4003-9606-ea44bac82330 could not be found. Sep 15 07:45:02.871729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '81bf969c-3300-4003-9606-ea44bac82330'} Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81bf969c-3300-4003-9606-ea44bac82330 could not be found. Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:02.872629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81bf969c-3300-4003-9606-ea44bac82330 could not be found. Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81bf969c-3300-4003-9606-ea44bac82330 could not be found. Sep 15 07:45:02.874168 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:02.875439 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Returning 404 to user: Instance 81bf969c-3300-4003-9606-ea44bac82330 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:02.875439 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-803c2b1a-7d31-4878-87ef-4a86edb7197e tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330" status: 404 len: 111 microversion: 2.1 time: 0.031384 Sep 15 07:45:02.880129 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4c1ee438-d5c3-4e0f-9bb9-29ca6865459f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:02.880747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4c1ee438-d5c3-4e0f-9bb9-29ca6865459f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:02.886023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 397/766] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:02 2022] GET /compute/v2.1/servers/81bf969c-3300-4003-9606-ea44bac82330 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:45:02.888457 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c1ee438-d5c3-4e0f-9bb9-29ca6865459f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:02.888736 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-cedf6d15-a17d-4e7b-8e1b-12da73985d68 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:02.889148 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c1ee438-d5c3-4e0f-9bb9-29ca6865459f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:02.889270 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-cedf6d15-a17d-4e7b-8e1b-12da73985d68 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:02.889811 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c1ee438-d5c3-4e0f-9bb9-29ca6865459f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:02.890611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c1ee438-d5c3-4e0f-9bb9-29ca6865459f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:02.891169 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c1ee438-d5c3-4e0f-9bb9-29ca6865459f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:02.891712 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4c1ee438-d5c3-4e0f-9bb9-29ca6865459f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:02.895247 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cedf6d15-a17d-4e7b-8e1b-12da73985d68 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:02.895749 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cedf6d15-a17d-4e7b-8e1b-12da73985d68 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:02.896193 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cedf6d15-a17d-4e7b-8e1b-12da73985d68 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:02.896925 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cedf6d15-a17d-4e7b-8e1b-12da73985d68 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:02.897567 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cedf6d15-a17d-4e7b-8e1b-12da73985d68 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:02.898035 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cedf6d15-a17d-4e7b-8e1b-12da73985d68 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:02.931726 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-cedf6d15-a17d-4e7b-8e1b-12da73985d68 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:45:03.043154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:03.048059 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4c1ee438-d5c3-4e0f-9bb9-29ca6865459f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:03.057097 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4c1ee438-d5c3-4e0f-9bb9-29ca6865459f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.180690 Sep 15 07:45:03.058117 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 370/767] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:02 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:03.196913 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-cedf6d15-a17d-4e7b-8e1b-12da73985d68 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "DELETE /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 204 len: 0 microversion: 2.1 time: 0.311399 Sep 15 07:45:03.197775 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 398/768] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:45:02 2022] DELETE /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:45:03.205871 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f150db8e-fc9e-4004-a88d-1d400bff31c7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:03.208237 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f150db8e-fc9e-4004-a88d-1d400bff31c7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:03.213727 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f150db8e-fc9e-4004-a88d-1d400bff31c7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:03.214217 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f150db8e-fc9e-4004-a88d-1d400bff31c7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:03.214648 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f150db8e-fc9e-4004-a88d-1d400bff31c7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:03.215342 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f150db8e-fc9e-4004-a88d-1d400bff31c7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:03.215790 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f150db8e-fc9e-4004-a88d-1d400bff31c7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:03.216210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f150db8e-fc9e-4004-a88d-1d400bff31c7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:03.357270 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f150db8e-fc9e-4004-a88d-1d400bff31c7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:03.365471 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f150db8e-fc9e-4004-a88d-1d400bff31c7 tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.163284 Sep 15 07:45:03.366081 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 371/769] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:03 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:03.702342 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:03.702953 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:03.709620 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:03.710336 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:03.710862 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:03.712125 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:03.712714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:03.713254 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:03.791435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:03.792148 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:03.798508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:03.798996 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:03.799436 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:03.800130 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:03.800584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:03.801041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:03.833781 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:03.834272 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:03.834701 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:03.835146 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lazy-loading 'fault' on Instance uuid 7cfb1a22-faac-4d66-874d-e7866a02a054 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:45:03.844847 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:03.854013 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:03.855370 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:03.856754 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-8bb8b973-19aa-40c2-a907-f29ab3108915 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.158931 Sep 15 07:45:03.857332 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 399/770] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:03 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:45:03.880206 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:03.888410 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-21d8a250-fb1d-4e10-9ca7-784d48f8ed2d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1230 microversion: 2.1 time: 0.101447 Sep 15 07:45:03.889019 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 372/771] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:03 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:04.080287 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-de5a5883-c2ca-463e-b785-269531182b9a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:04.080900 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-de5a5883-c2ca-463e-b785-269531182b9a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:04.087055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de5a5883-c2ca-463e-b785-269531182b9a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:04.087531 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de5a5883-c2ca-463e-b785-269531182b9a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:04.087969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de5a5883-c2ca-463e-b785-269531182b9a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:04.088651 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de5a5883-c2ca-463e-b785-269531182b9a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:04.089101 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de5a5883-c2ca-463e-b785-269531182b9a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:04.089522 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de5a5883-c2ca-463e-b785-269531182b9a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:04.219006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-de5a5883-c2ca-463e-b785-269531182b9a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:04.227210 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-de5a5883-c2ca-463e-b785-269531182b9a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.150291 Sep 15 07:45:04.227800 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 400/772] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:04 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:04.388456 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ff24b990-5bb3-4232-a272-44b71da4bfdc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:04.388975 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ff24b990-5bb3-4232-a272-44b71da4bfdc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:04.395011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff24b990-5bb3-4232-a272-44b71da4bfdc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:04.395491 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff24b990-5bb3-4232-a272-44b71da4bfdc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:04.395917 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff24b990-5bb3-4232-a272-44b71da4bfdc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:04.396597 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff24b990-5bb3-4232-a272-44b71da4bfdc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:04.397046 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff24b990-5bb3-4232-a272-44b71da4bfdc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:04.397466 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff24b990-5bb3-4232-a272-44b71da4bfdc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:04.524800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ff24b990-5bb3-4232-a272-44b71da4bfdc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:04.532443 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ff24b990-5bb3-4232-a272-44b71da4bfdc tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.147962 Sep 15 07:45:04.533013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 373/773] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:04 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:04.882395 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:04.883663 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:04.890971 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:04.890971 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:04.891325 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:04.892008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:04.892463 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:04.892884 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:04.915569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:04.916418 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:04.923057 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:04.923625 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:04.924266 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:04.925046 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:04.925593 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:04.926232 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:04.963621 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:04.964126 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:04.964570 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:04.965094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lazy-loading 'fault' on Instance uuid 7cfb1a22-faac-4d66-874d-e7866a02a054 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:45:05.025715 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:05.031376 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-59c84588-8020-47ef-ad7f-be74ad070aa7 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1230 microversion: 2.1 time: 0.119783 Sep 15 07:45:05.032135 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 374/774] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:04 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1230 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:05.063337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:05.071705 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:05.073152 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:05.074346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b98d6a3b-404b-402a-bc36-b5c82c048813 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.195819 Sep 15 07:45:05.074903 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 401/775] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:04 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:45:05.251879 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d65e3609-7941-424a-b793-2c7845819b94 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:05.252405 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d65e3609-7941-424a-b793-2c7845819b94 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:05.258793 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d65e3609-7941-424a-b793-2c7845819b94 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:05.259318 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d65e3609-7941-424a-b793-2c7845819b94 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:05.259755 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d65e3609-7941-424a-b793-2c7845819b94 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:05.260444 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d65e3609-7941-424a-b793-2c7845819b94 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:05.260900 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d65e3609-7941-424a-b793-2c7845819b94 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:05.261323 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d65e3609-7941-424a-b793-2c7845819b94 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:05.389211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d65e3609-7941-424a-b793-2c7845819b94 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:05.396827 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d65e3609-7941-424a-b793-2c7845819b94 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.148854 Sep 15 07:45:05.397398 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 375/776] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:05 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:05.555795 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a6f3cca5-15ad-4bb4-8016-f1090d5d279b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:05.556423 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a6f3cca5-15ad-4bb4-8016-f1090d5d279b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:05.562443 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6f3cca5-15ad-4bb4-8016-f1090d5d279b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:05.562932 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6f3cca5-15ad-4bb4-8016-f1090d5d279b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:05.563373 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6f3cca5-15ad-4bb4-8016-f1090d5d279b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:05.564066 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6f3cca5-15ad-4bb4-8016-f1090d5d279b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:05.564524 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6f3cca5-15ad-4bb4-8016-f1090d5d279b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:05.564953 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a6f3cca5-15ad-4bb4-8016-f1090d5d279b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:05.694957 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a6f3cca5-15ad-4bb4-8016-f1090d5d279b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:05.703178 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a6f3cca5-15ad-4bb4-8016-f1090d5d279b tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.151435 Sep 15 07:45:05.703744 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 402/777] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:05 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:06.054242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:06.055365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:06.062306 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:06.062857 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:06.063356 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:06.064110 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:06.064632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:06.065118 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:06.098823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:06.099308 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:06.099659 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:06.100119 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:06.100211 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lazy-loading 'fault' on Instance uuid 7cfb1a22-faac-4d66-874d-e7866a02a054 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:45:06.100306 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:06.106784 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:06.107262 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:06.107697 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:06.108388 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:06.108841 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:06.109270 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:06.144029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:06.152775 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2d3b8a56-5d3b-4f9b-a640-b70ff1e62b5d tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1230 microversion: 2.1 time: 0.102282 Sep 15 07:45:06.153524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 376/778] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:06 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:06.248919 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:06.257032 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:06.259128 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:06.260303 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c4c33f01-8e06-4d02-bfd3-48c6654031cc tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1729 microversion: 2.20 time: 0.164579 Sep 15 07:45:06.260856 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 403/779] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:06 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:45:06.420135 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bf8081e7-e837-4b30-b519-a91c1ad8b4d8 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:06.420747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bf8081e7-e837-4b30-b519-a91c1ad8b4d8 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:06.426684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf8081e7-e837-4b30-b519-a91c1ad8b4d8 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:06.427170 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf8081e7-e837-4b30-b519-a91c1ad8b4d8 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:06.427641 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf8081e7-e837-4b30-b519-a91c1ad8b4d8 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:06.428328 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf8081e7-e837-4b30-b519-a91c1ad8b4d8 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:06.428782 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf8081e7-e837-4b30-b519-a91c1ad8b4d8 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:06.429204 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bf8081e7-e837-4b30-b519-a91c1ad8b4d8 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:06.445833 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:06.574465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bf8081e7-e837-4b30-b519-a91c1ad8b4d8 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:06.582133 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bf8081e7-e837-4b30-b519-a91c1ad8b4d8 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.165759 Sep 15 07:45:06.582659 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 377/780] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:06 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:06.726626 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-69ecaefb-2663-4545-9440-4d743bc432bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:06.727218 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-69ecaefb-2663-4545-9440-4d743bc432bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:06.733481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-69ecaefb-2663-4545-9440-4d743bc432bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:06.734021 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-69ecaefb-2663-4545-9440-4d743bc432bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:06.734456 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-69ecaefb-2663-4545-9440-4d743bc432bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:06.735137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-69ecaefb-2663-4545-9440-4d743bc432bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:06.735593 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-69ecaefb-2663-4545-9440-4d743bc432bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:06.736074 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-69ecaefb-2663-4545-9440-4d743bc432bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:06.916010 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-69ecaefb-2663-4545-9440-4d743bc432bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:06.923838 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-69ecaefb-2663-4545-9440-4d743bc432bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1522 microversion: 2.1 time: 0.201143 Sep 15 07:45:06.924400 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 404/781] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:06 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:07.177457 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:07.178741 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:07.188685 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:07.189203 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:07.189656 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:07.190616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:07.191018 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:07.195569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:07.225111 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:07.225742 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:07.226813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:07.227358 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lazy-loading 'fault' on Instance uuid 7cfb1a22-faac-4d66-874d-e7866a02a054 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:45:07.287028 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:07.287746 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:07.294776 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:07.295333 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:07.295836 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:07.296627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:07.297138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:07.297563 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:07.307231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:07.315244 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4b5ece45-f047-4432-8416-3c229a3d558b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 200 len: 1184 microversion: 2.1 time: 0.142138 Sep 15 07:45:07.329598 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 378/782] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:07 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 1184 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:07.507060 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:07.515552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:07.517026 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:07.519377 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ebf586fa-52bb-4f27-bc0a-bf0cbaa69dff tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1716 microversion: 2.20 time: 0.236231 Sep 15 07:45:07.519377 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 405/783] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:07 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1716 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:45:07.606256 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9e31025a-b08d-4feb-b1df-fb3ec9bd6403 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:07.606910 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-9e31025a-b08d-4feb-b1df-fb3ec9bd6403 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:07.612820 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9e31025a-b08d-4feb-b1df-fb3ec9bd6403 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:07.613307 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9e31025a-b08d-4feb-b1df-fb3ec9bd6403 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:07.613820 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9e31025a-b08d-4feb-b1df-fb3ec9bd6403 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:07.614785 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9e31025a-b08d-4feb-b1df-fb3ec9bd6403 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:07.615243 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9e31025a-b08d-4feb-b1df-fb3ec9bd6403 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:07.615669 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9e31025a-b08d-4feb-b1df-fb3ec9bd6403 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:07.801110 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-dbd0a47d-091c-4579-ac29-baf04b3dcb36 req-3a56817b-b3b0-46fe-a122-7b3f7197f02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48afb5a2-e7d3-44a4-8882-d81cfd5418ab", "name": "network-vif-deleted", "tag": "2a6554f6-3c98-4833-bfe1-d3631c864347"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:07.811097 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-dbd0a47d-091c-4579-ac29-baf04b3dcb36 req-3a56817b-b3b0-46fe-a122-7b3f7197f02a service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:07.811674 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-dbd0a47d-091c-4579-ac29-baf04b3dcb36 req-3a56817b-b3b0-46fe-a122-7b3f7197f02a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:07.812171 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-dbd0a47d-091c-4579-ac29-baf04b3dcb36 req-3a56817b-b3b0-46fe-a122-7b3f7197f02a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:07.827398 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-9e31025a-b08d-4feb-b1df-fb3ec9bd6403 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:07.829712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-dbd0a47d-091c-4579-ac29-baf04b3dcb36 req-3a56817b-b3b0-46fe-a122-7b3f7197f02a service nova] Creating event network-vif-deleted:2a6554f6-3c98-4833-bfe1-d3631c864347 for instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab on hv-cinder-82414 Sep 15 07:45:07.836312 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9e31025a-b08d-4feb-b1df-fb3ec9bd6403 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.233882 Sep 15 07:45:07.837106 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-dbd0a47d-091c-4579-ac29-baf04b3dcb36 req-3a56817b-b3b0-46fe-a122-7b3f7197f02a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038029 Sep 15 07:45:07.837241 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 379/784] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:07 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:07.837480 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 406/785] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:45:07.951592 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-331d698f-d1a1-4630-bdca-df975166a37d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:07.951592 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-331d698f-d1a1-4630-bdca-df975166a37d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:07.957309 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-331d698f-d1a1-4630-bdca-df975166a37d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:07.957907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-331d698f-d1a1-4630-bdca-df975166a37d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:07.958436 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-331d698f-d1a1-4630-bdca-df975166a37d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:07.959192 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-331d698f-d1a1-4630-bdca-df975166a37d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:07.959720 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-331d698f-d1a1-4630-bdca-df975166a37d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:07.960340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-331d698f-d1a1-4630-bdca-df975166a37d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:08.027981 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-331d698f-d1a1-4630-bdca-df975166a37d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21de3a85b2df4af2833a24ab02f477c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc69db806d24d1f8eb18aadaaafabcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:08.035687 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-331d698f-d1a1-4630-bdca-df975166a37d tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 200 len: 1306 microversion: 2.1 time: 0.092078 Sep 15 07:45:08.036484 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 380/786] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:07 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 1306 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:08.340206 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:08.341026 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:08.346527 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-06f41afe-613d-48c4-bc72-671868dce1a4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:08.347029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-06f41afe-613d-48c4-bc72-671868dce1a4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:08.347840 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:08.348328 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:08.348762 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:08.349458 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:08.349941 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:08.350369 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:08.353886 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-06f41afe-613d-48c4-bc72-671868dce1a4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:08.354398 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-06f41afe-613d-48c4-bc72-671868dce1a4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:08.354819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-06f41afe-613d-48c4-bc72-671868dce1a4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:08.355516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-06f41afe-613d-48c4-bc72-671868dce1a4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:08.355974 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-06f41afe-613d-48c4-bc72-671868dce1a4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:08.356402 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-06f41afe-613d-48c4-bc72-671868dce1a4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:08.364927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] HTTP exception thrown: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Request method failure captured: Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 HTTP/1.1 Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItcWC41YL-jEVAfW5k8T8Z8Masg0gZERzqCt59hTF6N1xH-NPU0wnCafBgJJ2gizVmrnurujP53HbFQ1SX7gc3wojMxYvmcKhb-vjgp7tOgfGMyR7rh8MDYWjMfSKbXxbPPBa7xkGFBsroXBEh8YllbqAQmdCdq6XRCteGS7aDC2hJc Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: af1e008c4bfa41e18488c63ea0f17b27 Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-TestVolumeBootPattern-610100506 Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:45:08.366642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af1e008c4bfa41e18488c63ea0f17b27"}]}] Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-TestVolumeBootPattern-610100506 Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: af1e008c4bfa41e18488c63ea0f17b27 Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-TestVolumeBootPattern-610100506 Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-TestVolumeBootPattern-610100506-project Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: ebd85e42855448268c89a200f4392316 Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-TestVolumeBootPattern-610100506-project Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:45:08.368224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '7cfb1a22-faac-4d66-874d-e7866a02a054'} Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:08.369055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:45:08.370771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:08.372081 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Returning 404 to user: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:08.372081 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e9b759ef-eb28-4153-83d9-4c47469c1303 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 404 len: 111 microversion: 2.1 time: 0.032679 Sep 15 07:45:08.372081 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 407/787] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:08 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:45:08.441752 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-06f41afe-613d-48c4-bc72-671868dce1a4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lazy-loading 'services' on Instance uuid 07952150-a64f-434a-8fcc-d7ff89215b84 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:45:08.468742 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1972594743", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2002691772", "security_groups": [{"name": "tempest-secgroup-smoke-1463350431"}], "block_device_mapping_v2": [{"uuid": "148c718c-4068-4a83-89a8-754b6397da7d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2c10a638-2533-4c87-88f1-ce4db4dec0fd"}]}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:08.593517 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.network.neutron [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] validate_networks() for [('2c10a638-2533-4c87-88f1-ce4db4dec0fd', None, None, None, None, None)] {{(pid=132674) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:45:08.636124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-06f41afe-613d-48c4-bc72-671868dce1a4 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/os-volume_attachments/6e21756b-b571-471f-b760-0f0dbf7dab4f" status: 202 len: 0 microversion: 2.1 time: 0.293321 Sep 15 07:45:08.636769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 381/788] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:45:08 2022] DELETE /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/os-volume_attachments/6e21756b-b571-471f-b760-0f0dbf7dab4f => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 07:45:08.646856 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-cfac48b5-e305-463d-974b-7bd54756c1b5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:08.650482 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-cfac48b5-e305-463d-974b-7bd54756c1b5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:08.652600 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=84 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:08.658024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cfac48b5-e305-463d-974b-7bd54756c1b5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:08.658514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cfac48b5-e305-463d-974b-7bd54756c1b5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:08.658947 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cfac48b5-e305-463d-974b-7bd54756c1b5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:08.659645 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cfac48b5-e305-463d-974b-7bd54756c1b5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:08.660094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cfac48b5-e305-463d-974b-7bd54756c1b5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:08.660649 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cfac48b5-e305-463d-974b-7bd54756c1b5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:08.695974 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-cfac48b5-e305-463d-974b-7bd54756c1b5 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054439 Sep 15 07:45:08.696735 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 382/789] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:45:08 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:45:08.860573 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3dd215af-36a3-4fcb-bff9-35a11176dbd2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:08.861324 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3dd215af-36a3-4fcb-bff9-35a11176dbd2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:08.868120 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3dd215af-36a3-4fcb-bff9-35a11176dbd2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:08.868595 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3dd215af-36a3-4fcb-bff9-35a11176dbd2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:08.869031 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3dd215af-36a3-4fcb-bff9-35a11176dbd2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:08.869761 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3dd215af-36a3-4fcb-bff9-35a11176dbd2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:08.870216 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3dd215af-36a3-4fcb-bff9-35a11176dbd2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:08.870638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3dd215af-36a3-4fcb-bff9-35a11176dbd2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:09.034624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Flavor limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:45:09.035120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Image limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:45:09.035662 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Flavor pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:45:09.036140 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Image pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:45:09.036643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:45:09.045549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:09.046049 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:09.046482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:09.047197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:09.047644 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:09.048064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:09.063091 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3dd215af-36a3-4fcb-bff9-35a11176dbd2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:09.066638 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Getting quotas for project af1e008c4bfa41e18488c63ea0f17b27. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:45:09.071326 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Getting quotas for user ebd85e42855448268c89a200f4392316 and project af1e008c4bfa41e18488c63ea0f17b27. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:45:09.071924 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3dd215af-36a3-4fcb-bff9-35a11176dbd2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.215452 Sep 15 07:45:09.077812 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 383/790] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:08 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:09.140016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Going to run 1 instances... {{(pid=132674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:45:09.142268 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='148c718c-4068-4a83-89a8-754b6397da7d',volume_size=None,volume_type=None)] {{(pid=132674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:45:09.143333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:09.143947 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] [instance: 48afb5a2-e7d3-44a4-8882-d81cfd5418ab] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:09.150361 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:09.150848 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:09.151283 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:09.151982 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:09.152435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:09.152863 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:09.170278 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] HTTP exception thrown: Instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab could not be found. Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Request method failure captured: Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab HTTP/1.1 Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItbY2L3ItdqVaB73YjwArZPr23BmX6ENHNLZJT2WdCDXyeVG5CK5pKWhEyleF5-RV2_raaWI0zXKOH-9Z9AH41lx9iUPkkpesBFRI5O9kzzv1YOcB8Wq1WkZItvtzmzZi5ZqhWF1QiKcU657CscGnDcQ5M8Dmr2TKDeM6OBUI71wxrM Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: cdc69db806d24d1f8eb18aadaaafabcb Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:45:09.172024 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cdc69db806d24d1f8eb18aadaaafabcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cdc69db806d24d1f8eb18aadaaafabcb"}]}] Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: cdc69db806d24d1f8eb18aadaaafabcb Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-192071295 Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-ServerRescueNegativeTestJSON-192071295-project Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 21de3a85b2df4af2833a24ab02f477c8 Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-ServerRescueNegativeTestJSON-192071295-project Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab could not be found. Sep 15 07:45:09.173387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '48afb5a2-e7d3-44a4-8882-d81cfd5418ab'} Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab could not be found. Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:09.174150 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab could not be found. Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab could not be found. Sep 15 07:45:09.175326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:09.176360 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] Returning 404 to user: Instance 48afb5a2-e7d3-44a4-8882-d81cfd5418ab could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:09.176360 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-61944bd3-ac8a-4dd4-b9ef-600ab322e6bb tempest-ServerRescueNegativeTestJSON-192071295 tempest-ServerRescueNegativeTestJSON-192071295-project] 10.222.0.42 "GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab" status: 404 len: 111 microversion: 2.1 time: 0.100348 Sep 15 07:45:09.176360 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 384/791] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:09 2022] GET /compute/v2.1/servers/48afb5a2-e7d3-44a4-8882-d81cfd5418ab => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:45:09.588362 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7e891193-125a-48a5-8430-842239e44dd6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.125107 Sep 15 07:45:09.594951 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 408/792] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:45:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:45:09.600080 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7766d823-9559-4d05-adf4-7f81fa1ea907 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:09.601286 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7766d823-9559-4d05-adf4-7f81fa1ea907 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:09.657064 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7766d823-9559-4d05-adf4-7f81fa1ea907 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:09.665159 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7766d823-9559-4d05-adf4-7f81fa1ea907 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1095 microversion: 2.1 time: 0.068942 Sep 15 07:45:09.678699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 385/793] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:09 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:09.709571 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-24639b32-1d83-4d19-a79c-fb5f97fd07ab tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:09.712505 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-24639b32-1d83-4d19-a79c-fb5f97fd07ab tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:09.719023 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24639b32-1d83-4d19-a79c-fb5f97fd07ab tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:09.719503 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24639b32-1d83-4d19-a79c-fb5f97fd07ab tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:09.720641 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24639b32-1d83-4d19-a79c-fb5f97fd07ab tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:09.720786 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24639b32-1d83-4d19-a79c-fb5f97fd07ab tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:09.721408 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24639b32-1d83-4d19-a79c-fb5f97fd07ab tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:09.722034 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-24639b32-1d83-4d19-a79c-fb5f97fd07ab tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:09.755299 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-24639b32-1d83-4d19-a79c-fb5f97fd07ab tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049944 Sep 15 07:45:09.755863 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 409/794] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:45:09 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 07:45:09.828168 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-32637635-ab4c-4ca8-a43a-62efd02d037e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:09.830162 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-32637635-ab4c-4ca8-a43a-62efd02d037e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:09.837112 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-32637635-ab4c-4ca8-a43a-62efd02d037e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:09.837799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-32637635-ab4c-4ca8-a43a-62efd02d037e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:09.838312 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-32637635-ab4c-4ca8-a43a-62efd02d037e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:09.839076 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-32637635-ab4c-4ca8-a43a-62efd02d037e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:09.839476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-32637635-ab4c-4ca8-a43a-62efd02d037e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:09.839901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-32637635-ab4c-4ca8-a43a-62efd02d037e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:09.869219 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-32637635-ab4c-4ca8-a43a-62efd02d037e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Going to try to terminate instance {{(pid=132673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:45:10.095843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-43fd128b-5607-46e3-8c58-af8e9be823b3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:10.096467 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-43fd128b-5607-46e3-8c58-af8e9be823b3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:10.105304 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43fd128b-5607-46e3-8c58-af8e9be823b3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:10.105828 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43fd128b-5607-46e3-8c58-af8e9be823b3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:10.106277 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43fd128b-5607-46e3-8c58-af8e9be823b3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:10.106986 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43fd128b-5607-46e3-8c58-af8e9be823b3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:10.107452 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43fd128b-5607-46e3-8c58-af8e9be823b3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:10.107878 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43fd128b-5607-46e3-8c58-af8e9be823b3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:10.155738 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-32637635-ab4c-4ca8-a43a-62efd02d037e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 204 len: 0 microversion: 2.1 time: 0.331248 Sep 15 07:45:10.156842 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 386/795] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:45:09 2022] DELETE /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:45:10.166498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2046638b-284a-4134-a846-6aa9339b5871 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:10.167202 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2046638b-284a-4134-a846-6aa9339b5871 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:10.173058 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2046638b-284a-4134-a846-6aa9339b5871 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:10.173562 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2046638b-284a-4134-a846-6aa9339b5871 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:10.174021 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2046638b-284a-4134-a846-6aa9339b5871 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:10.174751 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2046638b-284a-4134-a846-6aa9339b5871 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:10.175205 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2046638b-284a-4134-a846-6aa9339b5871 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:10.175633 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2046638b-284a-4134-a846-6aa9339b5871 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:10.323378 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-43fd128b-5607-46e3-8c58-af8e9be823b3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:10.339973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-43fd128b-5607-46e3-8c58-af8e9be823b3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.245802 Sep 15 07:45:10.342963 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 410/796] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:10 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:10.357868 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-2046638b-284a-4134-a846-6aa9339b5871 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:10.367563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2046638b-284a-4134-a846-6aa9339b5871 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1680 microversion: 2.1 time: 0.206076 Sep 15 07:45:10.368833 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 387/797] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:10 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:10.688265 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-13e53e77-4704-4cb0-aee4-983eac49377e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:10.688882 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-13e53e77-4704-4cb0-aee4-983eac49377e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:10.696197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-13e53e77-4704-4cb0-aee4-983eac49377e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:10.696685 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-13e53e77-4704-4cb0-aee4-983eac49377e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:10.697124 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-13e53e77-4704-4cb0-aee4-983eac49377e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:10.697849 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-13e53e77-4704-4cb0-aee4-983eac49377e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:10.698308 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-13e53e77-4704-4cb0-aee4-983eac49377e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:10.698733 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-13e53e77-4704-4cb0-aee4-983eac49377e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:10.762305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-13e53e77-4704-4cb0-aee4-983eac49377e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:10.770179 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-13e53e77-4704-4cb0-aee4-983eac49377e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1145 microversion: 2.1 time: 0.085698 Sep 15 07:45:10.770755 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 411/798] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:10 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:11.367690 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-61341ee0-1a85-4888-84c1-62ce93f2c36b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:11.369042 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-61341ee0-1a85-4888-84c1-62ce93f2c36b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:11.376760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61341ee0-1a85-4888-84c1-62ce93f2c36b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:11.377331 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61341ee0-1a85-4888-84c1-62ce93f2c36b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:11.377851 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61341ee0-1a85-4888-84c1-62ce93f2c36b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:11.378612 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61341ee0-1a85-4888-84c1-62ce93f2c36b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:11.379133 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61341ee0-1a85-4888-84c1-62ce93f2c36b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:11.379618 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-61341ee0-1a85-4888-84c1-62ce93f2c36b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:11.393020 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a8160846-276f-4f47-99d4-776f89bfe2cd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:11.394257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a8160846-276f-4f47-99d4-776f89bfe2cd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:11.400336 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a8160846-276f-4f47-99d4-776f89bfe2cd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:11.400809 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a8160846-276f-4f47-99d4-776f89bfe2cd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:11.401239 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a8160846-276f-4f47-99d4-776f89bfe2cd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:11.402582 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a8160846-276f-4f47-99d4-776f89bfe2cd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:11.403037 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a8160846-276f-4f47-99d4-776f89bfe2cd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:11.403460 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a8160846-276f-4f47-99d4-776f89bfe2cd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:11.664227 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-61341ee0-1a85-4888-84c1-62ce93f2c36b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:11.680071 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-61341ee0-1a85-4888-84c1-62ce93f2c36b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.318956 Sep 15 07:45:11.685806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 388/799] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:11 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:11.775742 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a8160846-276f-4f47-99d4-776f89bfe2cd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:11.790043 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a8160846-276f-4f47-99d4-776f89bfe2cd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1680 microversion: 2.1 time: 0.397590 Sep 15 07:45:11.792804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-08223d8a-606f-4c50-a952-426c7fe5199b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:11.793434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-08223d8a-606f-4c50-a952-426c7fe5199b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:11.800711 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08223d8a-606f-4c50-a952-426c7fe5199b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:11.802296 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 412/800] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:11 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1680 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:11.810051 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08223d8a-606f-4c50-a952-426c7fe5199b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:11.810889 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08223d8a-606f-4c50-a952-426c7fe5199b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:11.811758 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08223d8a-606f-4c50-a952-426c7fe5199b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:11.812357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08223d8a-606f-4c50-a952-426c7fe5199b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:11.812914 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-08223d8a-606f-4c50-a952-426c7fe5199b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:12.156087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-08223d8a-606f-4c50-a952-426c7fe5199b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:12.167577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-08223d8a-606f-4c50-a952-426c7fe5199b tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1137 microversion: 2.1 time: 0.378595 Sep 15 07:45:12.170465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 389/801] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:11 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1137 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:12.704005 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fd9b5e12-dce3-4119-9ce5-29653439a058 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:12.706791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-fd9b5e12-dce3-4119-9ce5-29653439a058 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:12.713521 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e12-dce3-4119-9ce5-29653439a058 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:12.714288 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e12-dce3-4119-9ce5-29653439a058 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:12.714912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e12-dce3-4119-9ce5-29653439a058 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:12.715781 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e12-dce3-4119-9ce5-29653439a058 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:12.716402 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e12-dce3-4119-9ce5-29653439a058 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:12.716973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fd9b5e12-dce3-4119-9ce5-29653439a058 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:12.815030 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3578f5a3-1731-4884-b662-88b9a9283d7a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:12.815675 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3578f5a3-1731-4884-b662-88b9a9283d7a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:12.824491 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3578f5a3-1731-4884-b662-88b9a9283d7a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:12.826569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3578f5a3-1731-4884-b662-88b9a9283d7a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:12.828699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3578f5a3-1731-4884-b662-88b9a9283d7a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:12.830074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3578f5a3-1731-4884-b662-88b9a9283d7a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:12.830709 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3578f5a3-1731-4884-b662-88b9a9283d7a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:12.832193 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3578f5a3-1731-4884-b662-88b9a9283d7a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:12.922522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3578f5a3-1731-4884-b662-88b9a9283d7a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:12.934501 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3578f5a3-1731-4884-b662-88b9a9283d7a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1613 microversion: 2.1 time: 0.123284 Sep 15 07:45:12.941254 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 390/802] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:12 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1613 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:13.103476 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-fd9b5e12-dce3-4119-9ce5-29653439a058 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:13.120915 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fd9b5e12-dce3-4119-9ce5-29653439a058 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.420616 Sep 15 07:45:13.129668 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 413/803] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:12 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:13.191458 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a1a0be70-b0aa-45b9-b59d-e37e57610326 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:13.192552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a1a0be70-b0aa-45b9-b59d-e37e57610326 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:13.199855 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1a0be70-b0aa-45b9-b59d-e37e57610326 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:13.200428 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1a0be70-b0aa-45b9-b59d-e37e57610326 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:13.201078 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1a0be70-b0aa-45b9-b59d-e37e57610326 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:13.202675 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1a0be70-b0aa-45b9-b59d-e37e57610326 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:13.203949 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1a0be70-b0aa-45b9-b59d-e37e57610326 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:13.204383 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a1a0be70-b0aa-45b9-b59d-e37e57610326 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:13.316546 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a1a0be70-b0aa-45b9-b59d-e37e57610326 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:13.336072 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a1a0be70-b0aa-45b9-b59d-e37e57610326 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1211 microversion: 2.1 time: 0.148722 Sep 15 07:45:13.337182 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 391/804] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:13 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1211 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:13.460373 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-9f581ef7-b4c9-4393-9667-da0b662614aa req-ac74d868-a356-456f-99f4-26f2a40dea6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07952150-a64f-434a-8fcc-d7ff89215b84", "name": "network-vif-deleted", "tag": "c0246052-5807-47eb-9a0b-f3f27149228f"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:13.470640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-9f581ef7-b4c9-4393-9667-da0b662614aa req-ac74d868-a356-456f-99f4-26f2a40dea6a service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:13.471130 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-9f581ef7-b4c9-4393-9667-da0b662614aa req-ac74d868-a356-456f-99f4-26f2a40dea6a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:13.471627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-9f581ef7-b4c9-4393-9667-da0b662614aa req-ac74d868-a356-456f-99f4-26f2a40dea6a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:13.485920 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-9f581ef7-b4c9-4393-9667-da0b662614aa req-ac74d868-a356-456f-99f4-26f2a40dea6a service nova] Creating event network-vif-deleted:c0246052-5807-47eb-9a0b-f3f27149228f for instance 07952150-a64f-434a-8fcc-d7ff89215b84 on hv-cinder-82414 Sep 15 07:45:13.495596 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-9f581ef7-b4c9-4393-9667-da0b662614aa req-ac74d868-a356-456f-99f4-26f2a40dea6a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039231 Sep 15 07:45:13.503846 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 414/805] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:45:13.964018 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b4aeb4aa-402a-4c12-b151-7b4d63e5779e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:13.964645 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b4aeb4aa-402a-4c12-b151-7b4d63e5779e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:13.982662 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4aeb4aa-402a-4c12-b151-7b4d63e5779e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:13.983214 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4aeb4aa-402a-4c12-b151-7b4d63e5779e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:13.983686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4aeb4aa-402a-4c12-b151-7b4d63e5779e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:13.984405 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4aeb4aa-402a-4c12-b151-7b4d63e5779e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:13.984891 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4aeb4aa-402a-4c12-b151-7b4d63e5779e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:13.985298 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b4aeb4aa-402a-4c12-b151-7b4d63e5779e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:14.077386 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b4aeb4aa-402a-4c12-b151-7b4d63e5779e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:14.088023 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b4aeb4aa-402a-4c12-b151-7b4d63e5779e tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1613 microversion: 2.1 time: 0.127807 Sep 15 07:45:14.088897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 392/806] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:13 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1613 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:14.158105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0d71045f-c207-4144-8867-327bf21ca6e2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:14.158105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0d71045f-c207-4144-8867-327bf21ca6e2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:14.159767 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d71045f-c207-4144-8867-327bf21ca6e2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:14.160273 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d71045f-c207-4144-8867-327bf21ca6e2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:14.160716 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d71045f-c207-4144-8867-327bf21ca6e2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:14.161421 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d71045f-c207-4144-8867-327bf21ca6e2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:14.161902 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d71045f-c207-4144-8867-327bf21ca6e2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:14.162865 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0d71045f-c207-4144-8867-327bf21ca6e2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:14.325246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0d71045f-c207-4144-8867-327bf21ca6e2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:14.333427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0d71045f-c207-4144-8867-327bf21ca6e2 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.188581 Sep 15 07:45:14.350626 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 415/807] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:14 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:14.362484 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e06bb814-4af0-4d3e-b325-781959c99850 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:14.363359 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e06bb814-4af0-4d3e-b325-781959c99850 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:14.373248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e06bb814-4af0-4d3e-b325-781959c99850 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:14.377465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e06bb814-4af0-4d3e-b325-781959c99850 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:14.377465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e06bb814-4af0-4d3e-b325-781959c99850 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:14.377465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e06bb814-4af0-4d3e-b325-781959c99850 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:14.377465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e06bb814-4af0-4d3e-b325-781959c99850 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:14.378280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e06bb814-4af0-4d3e-b325-781959c99850 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:14.382043 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:14.553443 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e06bb814-4af0-4d3e-b325-781959c99850 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:14.562898 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e06bb814-4af0-4d3e-b325-781959c99850 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1279 microversion: 2.1 time: 0.206157 Sep 15 07:45:14.563677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 393/808] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:14 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:15.123539 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:15.123539 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:15.125917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:15.126414 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:15.126859 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:15.127568 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:15.128025 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:15.128452 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:15.163147 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:15.163735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:15.164156 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:15.164566 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lazy-loading 'fault' on Instance uuid 07952150-a64f-434a-8fcc-d7ff89215b84 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:45:15.213382 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0c8d7aa4db455a94631becf212866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14017d5edbbd4068b529d5d92444182a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:15.221809 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3d218e22-87cf-46e8-9117-9802523c2961 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 200 len: 1331 microversion: 2.1 time: 0.110551 Sep 15 07:45:15.222624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 416/809] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:15 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:15.339892 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-67fba2cb-c3fb-47a6-ad35-863e0a6298fa req-bc5021ee-108a-4f19-9b10-8f5def26107a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbef2c3-07c4-4165-b994-cf399a858379", "tag": "3f042454-cf32-4a00-ae9e-6827217983a6"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:15.350537 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-67fba2cb-c3fb-47a6-ad35-863e0a6298fa req-bc5021ee-108a-4f19-9b10-8f5def26107a service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:15.351001 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-67fba2cb-c3fb-47a6-ad35-863e0a6298fa req-bc5021ee-108a-4f19-9b10-8f5def26107a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:15.351419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-67fba2cb-c3fb-47a6-ad35-863e0a6298fa req-bc5021ee-108a-4f19-9b10-8f5def26107a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:15.358474 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-27500f96-3f8d-4ef9-8de4-671460a4be4a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:15.359399 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-27500f96-3f8d-4ef9-8de4-671460a4be4a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:15.363330 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-67fba2cb-c3fb-47a6-ad35-863e0a6298fa req-bc5021ee-108a-4f19-9b10-8f5def26107a service nova] Creating event network-changed:3f042454-cf32-4a00-ae9e-6827217983a6 for instance fbbef2c3-07c4-4165-b994-cf399a858379 on hv-cinder-82414 Sep 15 07:45:15.367255 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-27500f96-3f8d-4ef9-8de4-671460a4be4a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:15.368051 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-27500f96-3f8d-4ef9-8de4-671460a4be4a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:15.368699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-67fba2cb-c3fb-47a6-ad35-863e0a6298fa req-bc5021ee-108a-4f19-9b10-8f5def26107a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032393 Sep 15 07:45:15.369014 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-27500f96-3f8d-4ef9-8de4-671460a4be4a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:15.369674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 394/810] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:45:15.370255 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-27500f96-3f8d-4ef9-8de4-671460a4be4a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:15.370972 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-27500f96-3f8d-4ef9-8de4-671460a4be4a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:15.371841 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-27500f96-3f8d-4ef9-8de4-671460a4be4a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:15.421062 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:15.549638 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-27500f96-3f8d-4ef9-8de4-671460a4be4a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:15.562841 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-27500f96-3f8d-4ef9-8de4-671460a4be4a tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.208447 Sep 15 07:45:15.563527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 417/811] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:15 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:15.587832 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-40aef883-6e4e-4616-a40d-e929906e5134 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:15.588805 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-40aef883-6e4e-4616-a40d-e929906e5134 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:15.596431 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-40aef883-6e4e-4616-a40d-e929906e5134 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:15.596918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-40aef883-6e4e-4616-a40d-e929906e5134 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:15.597354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-40aef883-6e4e-4616-a40d-e929906e5134 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:15.598082 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-40aef883-6e4e-4616-a40d-e929906e5134 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:15.598571 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-40aef883-6e4e-4616-a40d-e929906e5134 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:15.602496 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-40aef883-6e4e-4616-a40d-e929906e5134 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:15.774869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-40aef883-6e4e-4616-a40d-e929906e5134 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:15.784483 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-40aef883-6e4e-4616-a40d-e929906e5134 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.201142 Sep 15 07:45:15.785074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 395/812] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:15 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:16.252255 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:16.253097 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:16.261207 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:16.261662 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:16.262109 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:16.262848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:16.263294 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:16.263729 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:16.279530 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 HTTP/1.1 Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:45:16.281958 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:16.285197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '07952150-a64f-434a-8fcc-d7ff89215b84'} Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:16.286211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:16.287643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:16.289602 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:16.289602 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4e27c88c-4a6c-42a4-b9d4-4850911c41f2 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 404 len: 111 microversion: 2.1 time: 0.035457 Sep 15 07:45:16.292820 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-dffd5aad-9ade-4bc6-b080-c73d714e811a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '.version_select at 0x7ff36c8679d0>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:16.297388 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 418/813] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:16 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:45:16.384543 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-dffd5aad-9ade-4bc6-b080-c73d714e811a tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113243292" status: 202 len: 0 microversion: 2.1 time: 0.095464 Sep 15 07:45:16.389006 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 396/814] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Sep 15 07:45:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113243292 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:45:16.587053 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b10e665e-5cdc-45a8-9cf3-21b37c852584 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:16.587700 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b10e665e-5cdc-45a8-9cf3-21b37c852584 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:16.593986 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b10e665e-5cdc-45a8-9cf3-21b37c852584 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:16.594341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b10e665e-5cdc-45a8-9cf3-21b37c852584 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:16.594777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b10e665e-5cdc-45a8-9cf3-21b37c852584 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:16.595471 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b10e665e-5cdc-45a8-9cf3-21b37c852584 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:16.595921 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b10e665e-5cdc-45a8-9cf3-21b37c852584 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:16.596341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b10e665e-5cdc-45a8-9cf3-21b37c852584 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:16.764979 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b10e665e-5cdc-45a8-9cf3-21b37c852584 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:16.774862 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b10e665e-5cdc-45a8-9cf3-21b37c852584 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1509 microversion: 2.1 time: 0.191879 Sep 15 07:45:16.775444 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 419/815] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:16 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:16.798312 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c8ebfb89-7a63-4590-ba4e-58bdd3f7e71d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:16.799224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c8ebfb89-7a63-4590-ba4e-58bdd3f7e71d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:16.805964 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8ebfb89-7a63-4590-ba4e-58bdd3f7e71d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:16.806772 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8ebfb89-7a63-4590-ba4e-58bdd3f7e71d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:16.807449 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8ebfb89-7a63-4590-ba4e-58bdd3f7e71d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:16.807878 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e19ce826-7148-44b1-8a90-afff709292b4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:16.808753 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8ebfb89-7a63-4590-ba4e-58bdd3f7e71d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:16.808983 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e19ce826-7148-44b1-8a90-afff709292b4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:16.809257 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8ebfb89-7a63-4590-ba4e-58bdd3f7e71d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:16.810040 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c8ebfb89-7a63-4590-ba4e-58bdd3f7e71d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:16.816558 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e19ce826-7148-44b1-8a90-afff709292b4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:16.834016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e19ce826-7148-44b1-8a90-afff709292b4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:16.834016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e19ce826-7148-44b1-8a90-afff709292b4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:16.834016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e19ce826-7148-44b1-8a90-afff709292b4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:16.834016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e19ce826-7148-44b1-8a90-afff709292b4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:16.834814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e19ce826-7148-44b1-8a90-afff709292b4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:16.982305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e19ce826-7148-44b1-8a90-afff709292b4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:16.999006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e19ce826-7148-44b1-8a90-afff709292b4 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.195894 Sep 15 07:45:16.999825 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 420/816] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:16 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:17.015931 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-267a677e-6ba8-4386-ae9f-588e7d015de8 req-76c2d39c-7a07-4673-9318-5ebf91671463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d61aa0-bcb6-4fe0-bc26-20ef85c5025e", "name": "network-vif-unplugged", "status": "completed", "tag": "a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:17.024860 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c8ebfb89-7a63-4590-ba4e-58bdd3f7e71d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132673) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 15 07:45:17.025724 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-267a677e-6ba8-4386-ae9f-588e7d015de8 req-76c2d39c-7a07-4673-9318-5ebf91671463 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:17.026419 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-267a677e-6ba8-4386-ae9f-588e7d015de8 req-76c2d39c-7a07-4673-9318-5ebf91671463 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:17.027068 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-267a677e-6ba8-4386-ae9f-588e7d015de8 req-76c2d39c-7a07-4673-9318-5ebf91671463 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:17.041287 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.compute.server_external_events [req-267a677e-6ba8-4386-ae9f-588e7d015de8 req-76c2d39c-7a07-4673-9318-5ebf91671463 service nova] Unable to find a host for instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e. Dropping event network-vif-unplugged {{(pid=132674) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 15 07:45:17.042626 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-267a677e-6ba8-4386-ae9f-588e7d015de8 req-76c2d39c-7a07-4673-9318-5ebf91671463 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041446 Sep 15 07:45:17.043446 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 421/817] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 15 07:45:17.327242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c8ebfb89-7a63-4590-ba4e-58bdd3f7e71d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "POST /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e/action" status: 202 len: 0 microversion: 2.1 time: 0.532799 Sep 15 07:45:17.328228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 397/818] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:45:16 2022] POST /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:45:17.336641 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d20ba709-6b89-45f1-bc36-df6cf0ab2564 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:17.337261 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d20ba709-6b89-45f1-bc36-df6cf0ab2564 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:17.344041 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d20ba709-6b89-45f1-bc36-df6cf0ab2564 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:17.344533 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d20ba709-6b89-45f1-bc36-df6cf0ab2564 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:17.344977 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d20ba709-6b89-45f1-bc36-df6cf0ab2564 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:17.345763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d20ba709-6b89-45f1-bc36-df6cf0ab2564 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:17.346226 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d20ba709-6b89-45f1-bc36-df6cf0ab2564 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:17.346657 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d20ba709-6b89-45f1-bc36-df6cf0ab2564 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:17.552006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d20ba709-6b89-45f1-bc36-df6cf0ab2564 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:17.563024 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d20ba709-6b89-45f1-bc36-df6cf0ab2564 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1517 microversion: 2.1 time: 0.230529 Sep 15 07:45:17.564214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 422/819] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:17 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:18.029434 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-775654ef-64bb-457e-bf98-0c19e54f1129 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:18.030167 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-775654ef-64bb-457e-bf98-0c19e54f1129 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:18.036117 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-775654ef-64bb-457e-bf98-0c19e54f1129 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:18.036790 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-775654ef-64bb-457e-bf98-0c19e54f1129 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:18.037619 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-775654ef-64bb-457e-bf98-0c19e54f1129 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:18.044852 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-775654ef-64bb-457e-bf98-0c19e54f1129 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:18.045406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-775654ef-64bb-457e-bf98-0c19e54f1129 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:18.045864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-775654ef-64bb-457e-bf98-0c19e54f1129 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:18.199615 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-775654ef-64bb-457e-bf98-0c19e54f1129 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:18.207322 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-775654ef-64bb-457e-bf98-0c19e54f1129 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.183591 Sep 15 07:45:18.207887 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 398/820] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:18 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:18.590832 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ed0b9abe-412a-40b3-b1d6-2bcd8be181bd tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:18.591698 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ed0b9abe-412a-40b3-b1d6-2bcd8be181bd tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:18.597853 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed0b9abe-412a-40b3-b1d6-2bcd8be181bd tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:18.598342 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed0b9abe-412a-40b3-b1d6-2bcd8be181bd tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:18.598783 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed0b9abe-412a-40b3-b1d6-2bcd8be181bd tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:18.600356 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed0b9abe-412a-40b3-b1d6-2bcd8be181bd tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:18.600824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed0b9abe-412a-40b3-b1d6-2bcd8be181bd tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:18.601255 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ed0b9abe-412a-40b3-b1d6-2bcd8be181bd tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:18.612864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:18.613367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:18.620280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:18.621185 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:18.621652 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:18.622351 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:18.622800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:18.623212 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:18.638260 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: DELETE /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 HTTP/1.1 Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:45:18.639930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:18.641373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '07952150-a64f-434a-8fcc-d7ff89215b84'} Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:18.642352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:18.643799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:18.645323 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:18.645323 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5b520c67-59a8-43d8-9bd7-8aa0ba58c665 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 404 len: 111 microversion: 2.1 time: 0.033248 Sep 15 07:45:18.646486 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 399/821] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:45:18 2022] DELETE /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 07:45:18.654157 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:18.660012 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 07952150-a64f-434a-8fcc-d7ff89215b84] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:18.662036 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:18.662598 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:18.663171 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:18.664008 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:18.664590 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:18.665077 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:18.683212 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 HTTP/1.1 Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:45:18.685524 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:18.687041 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '07952150-a64f-434a-8fcc-d7ff89215b84'} Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:18.687867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. Sep 15 07:45:18.689883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:18.695549 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 07952150-a64f-434a-8fcc-d7ff89215b84 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:18.695549 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-eabcfdfd-b984-47e7-bf9c-f7d11333140c tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84" status: 404 len: 111 microversion: 2.1 time: 0.038061 Sep 15 07:45:18.695549 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 400/822] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:18 2022] GET /compute/v2.1/servers/07952150-a64f-434a-8fcc-d7ff89215b84 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:45:18.771492 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ed0b9abe-412a-40b3-b1d6-2bcd8be181bd tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:18.779332 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ed0b9abe-412a-40b3-b1d6-2bcd8be181bd tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1519 microversion: 2.1 time: 0.192179 Sep 15 07:45:18.779897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 423/823] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:18 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:19.230875 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-334b0c9e-110d-4b86-93a2-cf6d290dc868 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:19.232934 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-334b0c9e-110d-4b86-93a2-cf6d290dc868 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:19.239295 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-334b0c9e-110d-4b86-93a2-cf6d290dc868 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:19.240069 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-334b0c9e-110d-4b86-93a2-cf6d290dc868 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:19.240332 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-334b0c9e-110d-4b86-93a2-cf6d290dc868 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:19.241030 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-334b0c9e-110d-4b86-93a2-cf6d290dc868 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:19.241603 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-334b0c9e-110d-4b86-93a2-cf6d290dc868 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:19.242070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-334b0c9e-110d-4b86-93a2-cf6d290dc868 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:19.385876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-334b0c9e-110d-4b86-93a2-cf6d290dc868 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:19.393551 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-334b0c9e-110d-4b86-93a2-cf6d290dc868 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.166717 Sep 15 07:45:19.394143 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 401/824] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:19 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:19.802368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-413ca60b-76bc-4247-9795-f73df676c42e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:19.803068 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-413ca60b-76bc-4247-9795-f73df676c42e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:19.805008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:19.805892 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=6 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:19.808302 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:19.811730 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-413ca60b-76bc-4247-9795-f73df676c42e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:19.812221 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-413ca60b-76bc-4247-9795-f73df676c42e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:19.812659 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-413ca60b-76bc-4247-9795-f73df676c42e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:19.813419 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-413ca60b-76bc-4247-9795-f73df676c42e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:19.813952 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-413ca60b-76bc-4247-9795-f73df676c42e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:19.814308 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-413ca60b-76bc-4247-9795-f73df676c42e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:19.988627 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:19.989274 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:19.992260 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:19.995985 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:19.996650 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:19.997081 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:19.997813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:19.998244 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:19.999052 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:20.009745 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-413ca60b-76bc-4247-9795-f73df676c42e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:20.015830 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: DELETE /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e HTTP/1.1 Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:45:20.017559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:45:20.019053 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '93a02c55-496c-4b57-9af0-d40fba32857e'} Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:20.019928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:45:20.021778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.029463 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:20.029463 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7ff78a1d-aa02-46dc-b359-fb797ad253e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 404 len: 111 microversion: 2.1 time: 0.039204 Sep 15 07:45:20.029463 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 402/825] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:45:19 2022] DELETE /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 07:45:20.029718 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-413ca60b-76bc-4247-9795-f73df676c42e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1575 microversion: 2.1 time: 0.226390 Sep 15 07:45:20.029718 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 424/826] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:19 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:20.032097 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:20.032705 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 93a02c55-496c-4b57-9af0-d40fba32857e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:20.039235 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:20.039718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:20.040149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:20.040826 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:20.041463 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:20.041905 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:20.056144 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e HTTP/1.1 Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:45:20.064368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:45:20.065788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '93a02c55-496c-4b57-9af0-d40fba32857e'} Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:20.066686 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. Sep 15 07:45:20.068800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.071682 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 93a02c55-496c-4b57-9af0-d40fba32857e could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:20.071682 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2f2f8958-b277-46f9-a343-71d741a8a5e6 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e" status: 404 len: 111 microversion: 2.1 time: 0.037382 Sep 15 07:45:20.071682 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 403/827] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:20 2022] GET /compute/v2.1/servers/93a02c55-496c-4b57-9af0-d40fba32857e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 07:45:20.075499 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:20.076022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:20.082514 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:20.083312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:20.083745 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:20.084431 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:20.084912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:20.085325 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:20.101175 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: DELETE /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 HTTP/1.1 Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:45:20.102737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:45:20.105848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '95c6ee4c-f348-424e-9fa6-ca2ee2f67967'} Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:20.106763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:45:20.108214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.109659 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:20.109659 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f8d742ba-a710-4221-a1d7-7393268a343f tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 404 len: 111 microversion: 2.1 time: 0.033357 Sep 15 07:45:20.109659 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 425/828] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:45:20 2022] DELETE /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:45:20.113042 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:20.113684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 95c6ee4c-f348-424e-9fa6-ca2ee2f67967] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:20.120059 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:20.120541 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:20.120972 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:20.121671 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:20.122206 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:20.122535 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:20.136255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 HTTP/1.1 Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:45:20.137890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:45:20.139470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '95c6ee4c-f348-424e-9fa6-ca2ee2f67967'} Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:20.140262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. Sep 15 07:45:20.141446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:20.150476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 95c6ee4c-f348-424e-9fa6-ca2ee2f67967 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:20.150476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-13e1aa21-2a9c-41c9-9518-2faff1c3c353 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967" status: 404 len: 111 microversion: 2.1 time: 0.030308 Sep 15 07:45:20.150476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 404/829] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:20 2022] GET /compute/v2.1/servers/95c6ee4c-f348-424e-9fa6-ca2ee2f67967 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 07:45:20.426927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-60a842ab-fada-4d38-8959-af0e5b172ee2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:20.427546 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-60a842ab-fada-4d38-8959-af0e5b172ee2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:20.433557 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60a842ab-fada-4d38-8959-af0e5b172ee2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:20.434542 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60a842ab-fada-4d38-8959-af0e5b172ee2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:20.435377 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60a842ab-fada-4d38-8959-af0e5b172ee2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:20.436304 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60a842ab-fada-4d38-8959-af0e5b172ee2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:20.438833 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60a842ab-fada-4d38-8959-af0e5b172ee2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:20.439457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-60a842ab-fada-4d38-8959-af0e5b172ee2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:20.746538 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-60a842ab-fada-4d38-8959-af0e5b172ee2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:20.754184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-60a842ab-fada-4d38-8959-af0e5b172ee2 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.332243 Sep 15 07:45:20.756018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 426/830] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:20 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:21.048182 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5087afec-6416-461c-8dcf-38248c0fbf33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:21.048798 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5087afec-6416-461c-8dcf-38248c0fbf33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:21.056093 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5087afec-6416-461c-8dcf-38248c0fbf33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:21.056577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5087afec-6416-461c-8dcf-38248c0fbf33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:21.057008 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5087afec-6416-461c-8dcf-38248c0fbf33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:21.057726 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5087afec-6416-461c-8dcf-38248c0fbf33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:21.058179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5087afec-6416-461c-8dcf-38248c0fbf33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:21.058607 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5087afec-6416-461c-8dcf-38248c0fbf33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:21.203780 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5087afec-6416-461c-8dcf-38248c0fbf33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:21.214541 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5087afec-6416-461c-8dcf-38248c0fbf33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1575 microversion: 2.1 time: 0.169338 Sep 15 07:45:21.215221 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 405/831] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:21 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:21.419356 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:21.419852 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:21.426220 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:21.431793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:21.431793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:21.431793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:21.431793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:21.432385 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:21.446398 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: DELETE /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 HTTP/1.1 Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:45:21.448104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:45:21.449605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '37cd67df-dd0e-4658-9b80-3c29efd65897'} Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:21.450337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:45:21.451491 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:21.452655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:21.452655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6c1e4c0e-39cc-40a9-911a-cbe1d144fbfd tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "DELETE /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 404 len: 111 microversion: 2.1 time: 0.033979 Sep 15 07:45:21.452655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 427/832] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:45:21 2022] DELETE /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:45:21.459331 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:21.459969 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] [instance: 37cd67df-dd0e-4658-9b80-3c29efd65897] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:21.465965 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:21.466446 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:21.466864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:21.467548 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:21.467993 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:21.468408 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:21.482899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] HTTP exception thrown: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Request method failure captured: Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 HTTP/1.1 Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaGsCFbaqgRezRbtkkqIdlKMyhaWRLw7-WqxwKUcePBh0CTycyxqLwM7b8N1-b8YRI4xOV_HbSVMAccXyBYA0B1rkI4AYN9E5cKPT80PmU4zGOEbGCH0r4O170eE94yF8wJus_Ouzb9gqDCEgMHfV4hCplsbKNaXzywprZ8QSjbjKc Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:45:21.485063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_14017d5edbbd4068b529d5d92444182a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/14017d5edbbd4068b529d5d92444182a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/14017d5edbbd4068b529d5d92444182a"}]}] Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 14017d5edbbd4068b529d5d92444182a Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1033429769 Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 5e0c8d7aa4db455a94631becf212866f Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeNegativeTest-1033429769-project Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:45:21.486638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '37cd67df-dd0e-4658-9b80-3c29efd65897'} Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:21.487692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. Sep 15 07:45:21.489462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:21.491577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] Returning 404 to user: Instance 37cd67df-dd0e-4658-9b80-3c29efd65897 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:21.491577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f0c40b23-27af-403e-b7e9-0e83d51db9d0 tempest-AttachVolumeNegativeTest-1033429769 tempest-AttachVolumeNegativeTest-1033429769-project] 10.222.0.42 "GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897" status: 404 len: 111 microversion: 2.1 time: 0.032773 Sep 15 07:45:21.491577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 406/833] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:21 2022] GET /compute/v2.1/servers/37cd67df-dd0e-4658-9b80-3c29efd65897 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:45:21.778654 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-82a4f7a6-b976-4015-b3f9-1f7285c4c4ef tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:21.779178 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-82a4f7a6-b976-4015-b3f9-1f7285c4c4ef tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:21.785003 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-82a4f7a6-b976-4015-b3f9-1f7285c4c4ef tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:21.785537 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-82a4f7a6-b976-4015-b3f9-1f7285c4c4ef tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:21.786096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-82a4f7a6-b976-4015-b3f9-1f7285c4c4ef tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:21.786789 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-82a4f7a6-b976-4015-b3f9-1f7285c4c4ef tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:21.787242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-82a4f7a6-b976-4015-b3f9-1f7285c4c4ef tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:21.787672 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-82a4f7a6-b976-4015-b3f9-1f7285c4c4ef tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:21.937940 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-82a4f7a6-b976-4015-b3f9-1f7285c4c4ef tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:21.946396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-82a4f7a6-b976-4015-b3f9-1f7285c4c4ef tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.171633 Sep 15 07:45:21.947553 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 428/834] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:21 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:22.239075 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ed88d7ba-56b2-4dc8-bc5d-fcb934f76714 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:22.239685 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ed88d7ba-56b2-4dc8-bc5d-fcb934f76714 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:22.246311 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed88d7ba-56b2-4dc8-bc5d-fcb934f76714 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:22.246793 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed88d7ba-56b2-4dc8-bc5d-fcb934f76714 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:22.247220 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed88d7ba-56b2-4dc8-bc5d-fcb934f76714 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:22.247911 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed88d7ba-56b2-4dc8-bc5d-fcb934f76714 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:22.248359 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed88d7ba-56b2-4dc8-bc5d-fcb934f76714 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:22.248775 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ed88d7ba-56b2-4dc8-bc5d-fcb934f76714 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:22.461117 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ed88d7ba-56b2-4dc8-bc5d-fcb934f76714 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:22.469233 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ed88d7ba-56b2-4dc8-bc5d-fcb934f76714 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1575 microversion: 2.1 time: 0.234575 Sep 15 07:45:22.469837 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 407/835] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:22 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:22.970423 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c6cdd4d2-4ff3-4ace-bd88-c66529f4764e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:22.971104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c6cdd4d2-4ff3-4ace-bd88-c66529f4764e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:22.978442 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6cdd4d2-4ff3-4ace-bd88-c66529f4764e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:22.978944 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6cdd4d2-4ff3-4ace-bd88-c66529f4764e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:22.979726 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6cdd4d2-4ff3-4ace-bd88-c66529f4764e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:22.980483 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6cdd4d2-4ff3-4ace-bd88-c66529f4764e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:22.980944 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6cdd4d2-4ff3-4ace-bd88-c66529f4764e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:22.981371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6cdd4d2-4ff3-4ace-bd88-c66529f4764e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:23.123635 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c6cdd4d2-4ff3-4ace-bd88-c66529f4764e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:23.132096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c6cdd4d2-4ff3-4ace-bd88-c66529f4764e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.165696 Sep 15 07:45:23.132655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 429/836] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:22 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:23.495089 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-73fdaa5b-b064-42c3-a3be-650b0dcf5939 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:23.496989 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-73fdaa5b-b064-42c3-a3be-650b0dcf5939 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:23.505743 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73fdaa5b-b064-42c3-a3be-650b0dcf5939 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:23.506546 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73fdaa5b-b064-42c3-a3be-650b0dcf5939 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:23.507219 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73fdaa5b-b064-42c3-a3be-650b0dcf5939 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:23.508337 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73fdaa5b-b064-42c3-a3be-650b0dcf5939 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:23.509092 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73fdaa5b-b064-42c3-a3be-650b0dcf5939 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:23.509800 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-73fdaa5b-b064-42c3-a3be-650b0dcf5939 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:23.674907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-73fdaa5b-b064-42c3-a3be-650b0dcf5939 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:23.688259 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-73fdaa5b-b064-42c3-a3be-650b0dcf5939 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1575 microversion: 2.1 time: 0.197738 Sep 15 07:45:23.688841 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 408/837] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:23 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:24.155382 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a0f74720-ef9d-4ea3-90c5-2275501119a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:24.156083 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a0f74720-ef9d-4ea3-90c5-2275501119a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:24.162576 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0f74720-ef9d-4ea3-90c5-2275501119a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:24.163149 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0f74720-ef9d-4ea3-90c5-2275501119a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:24.163950 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0f74720-ef9d-4ea3-90c5-2275501119a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:24.164437 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0f74720-ef9d-4ea3-90c5-2275501119a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:24.164899 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0f74720-ef9d-4ea3-90c5-2275501119a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:24.165309 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0f74720-ef9d-4ea3-90c5-2275501119a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:24.319353 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a0f74720-ef9d-4ea3-90c5-2275501119a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:24.328815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a0f74720-ef9d-4ea3-90c5-2275501119a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.177001 Sep 15 07:45:24.342485 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 430/838] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:24 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:24.714193 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-486732db-8100-4b05-944e-712edf721c3b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:24.714827 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-486732db-8100-4b05-944e-712edf721c3b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:24.724792 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-486732db-8100-4b05-944e-712edf721c3b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:24.725286 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-486732db-8100-4b05-944e-712edf721c3b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:24.725752 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-486732db-8100-4b05-944e-712edf721c3b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:24.726456 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-486732db-8100-4b05-944e-712edf721c3b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:24.728155 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-486732db-8100-4b05-944e-712edf721c3b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:24.730239 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-486732db-8100-4b05-944e-712edf721c3b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:25.025731 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-486732db-8100-4b05-944e-712edf721c3b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:25.049569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-486732db-8100-4b05-944e-712edf721c3b tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1575 microversion: 2.1 time: 0.339951 Sep 15 07:45:25.050668 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 409/839] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:24 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1575 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:25.357079 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-46a0be2d-1db7-44e4-8940-19f7c2f3573c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:25.357959 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-46a0be2d-1db7-44e4-8940-19f7c2f3573c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:25.366504 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46a0be2d-1db7-44e4-8940-19f7c2f3573c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:25.367858 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46a0be2d-1db7-44e4-8940-19f7c2f3573c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:25.369917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46a0be2d-1db7-44e4-8940-19f7c2f3573c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:25.376830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46a0be2d-1db7-44e4-8940-19f7c2f3573c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:25.377458 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46a0be2d-1db7-44e4-8940-19f7c2f3573c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:25.381706 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-46a0be2d-1db7-44e4-8940-19f7c2f3573c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:25.642938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-46a0be2d-1db7-44e4-8940-19f7c2f3573c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:25.653634 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-46a0be2d-1db7-44e4-8940-19f7c2f3573c tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.304510 Sep 15 07:45:25.654207 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 431/840] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:25 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:26.072257 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8a1e1592-39c7-431c-ae5c-383b71749070 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:26.072904 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8a1e1592-39c7-431c-ae5c-383b71749070 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:26.079582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a1e1592-39c7-431c-ae5c-383b71749070 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:26.080032 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a1e1592-39c7-431c-ae5c-383b71749070 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:26.080468 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a1e1592-39c7-431c-ae5c-383b71749070 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:26.081164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a1e1592-39c7-431c-ae5c-383b71749070 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:26.081677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a1e1592-39c7-431c-ae5c-383b71749070 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:26.082102 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8a1e1592-39c7-431c-ae5c-383b71749070 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:26.245543 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8a1e1592-39c7-431c-ae5c-383b71749070 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:26.254199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8a1e1592-39c7-431c-ae5c-383b71749070 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1575 microversion: 2.1 time: 0.185771 Sep 15 07:45:26.254785 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 410/841] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:26 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:26.676561 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-889fda93-b040-4b04-b221-0515138d6b35 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:26.677170 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-889fda93-b040-4b04-b221-0515138d6b35 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:26.683823 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889fda93-b040-4b04-b221-0515138d6b35 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:26.684312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889fda93-b040-4b04-b221-0515138d6b35 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:26.684778 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889fda93-b040-4b04-b221-0515138d6b35 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:26.685477 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889fda93-b040-4b04-b221-0515138d6b35 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:26.686070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889fda93-b040-4b04-b221-0515138d6b35 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:26.686356 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-889fda93-b040-4b04-b221-0515138d6b35 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:26.840571 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-889fda93-b040-4b04-b221-0515138d6b35 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:26.849030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-889fda93-b040-4b04-b221-0515138d6b35 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.176604 Sep 15 07:45:26.849616 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 432/842] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:26 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:27.146547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-b4ae67b6-103d-4ab7-b77e-8dc5c1f96f87 req-db5e2f02-6d96-4c29-aa32-683b6692e7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbef2c3-07c4-4165-b994-cf399a858379", "name": "network-vif-plugged", "status": "completed", "tag": "3f042454-cf32-4a00-ae9e-6827217983a6"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:27.156566 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-b4ae67b6-103d-4ab7-b77e-8dc5c1f96f87 req-db5e2f02-6d96-4c29-aa32-683b6692e7c6 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:27.157034 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-b4ae67b6-103d-4ab7-b77e-8dc5c1f96f87 req-db5e2f02-6d96-4c29-aa32-683b6692e7c6 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:27.157454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-b4ae67b6-103d-4ab7-b77e-8dc5c1f96f87 req-db5e2f02-6d96-4c29-aa32-683b6692e7c6 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:27.168756 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-b4ae67b6-103d-4ab7-b77e-8dc5c1f96f87 req-db5e2f02-6d96-4c29-aa32-683b6692e7c6 service nova] Creating event network-vif-plugged:3f042454-cf32-4a00-ae9e-6827217983a6 for instance fbbef2c3-07c4-4165-b994-cf399a858379 on hv-cinder-82414 Sep 15 07:45:27.173828 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-b4ae67b6-103d-4ab7-b77e-8dc5c1f96f87 req-db5e2f02-6d96-4c29-aa32-683b6692e7c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032195 Sep 15 07:45:27.174552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 411/843] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:45:27.279653 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ca7749c4-2706-448b-9a8e-4ccb031bfb56 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:27.281377 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ca7749c4-2706-448b-9a8e-4ccb031bfb56 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:27.289810 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ca7749c4-2706-448b-9a8e-4ccb031bfb56 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:27.290782 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ca7749c4-2706-448b-9a8e-4ccb031bfb56 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:27.291396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ca7749c4-2706-448b-9a8e-4ccb031bfb56 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:27.292099 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ca7749c4-2706-448b-9a8e-4ccb031bfb56 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:27.292548 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ca7749c4-2706-448b-9a8e-4ccb031bfb56 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:27.293105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ca7749c4-2706-448b-9a8e-4ccb031bfb56 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:27.432463 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ca7749c4-2706-448b-9a8e-4ccb031bfb56 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:27.442323 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ca7749c4-2706-448b-9a8e-4ccb031bfb56 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1575 microversion: 2.1 time: 0.168524 Sep 15 07:45:27.442982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 433/844] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:27 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:27.872946 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2e05e7b3-e634-4f8e-bf93-57e85804d104 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:27.873676 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2e05e7b3-e634-4f8e-bf93-57e85804d104 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:27.880621 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2e05e7b3-e634-4f8e-bf93-57e85804d104 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:27.881114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2e05e7b3-e634-4f8e-bf93-57e85804d104 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:27.881808 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2e05e7b3-e634-4f8e-bf93-57e85804d104 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:27.882525 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2e05e7b3-e634-4f8e-bf93-57e85804d104 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:27.882987 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2e05e7b3-e634-4f8e-bf93-57e85804d104 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:27.883417 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2e05e7b3-e634-4f8e-bf93-57e85804d104 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:28.094538 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-2e05e7b3-e634-4f8e-bf93-57e85804d104 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:28.102968 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2e05e7b3-e634-4f8e-bf93-57e85804d104 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.234283 Sep 15 07:45:28.103555 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 412/845] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:27 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:28.468275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4e12275f-f552-450d-b213-4f8f1b322903 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:28.468881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-4e12275f-f552-450d-b213-4f8f1b322903 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:28.476469 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e12275f-f552-450d-b213-4f8f1b322903 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:28.477151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e12275f-f552-450d-b213-4f8f1b322903 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:28.477619 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e12275f-f552-450d-b213-4f8f1b322903 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:28.478324 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e12275f-f552-450d-b213-4f8f1b322903 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:28.478780 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e12275f-f552-450d-b213-4f8f1b322903 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:28.479201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4e12275f-f552-450d-b213-4f8f1b322903 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:28.670882 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4e12275f-f552-450d-b213-4f8f1b322903 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:28.688382 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4e12275f-f552-450d-b213-4f8f1b322903 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1575 microversion: 2.1 time: 0.224102 Sep 15 07:45:28.688977 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 434/846] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:28 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:29.131040 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-016e6047-b9de-4243-aa13-13d1ddefa112 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:29.131723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-016e6047-b9de-4243-aa13-13d1ddefa112 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:29.138373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-016e6047-b9de-4243-aa13-13d1ddefa112 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:29.138867 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-016e6047-b9de-4243-aa13-13d1ddefa112 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:29.139301 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-016e6047-b9de-4243-aa13-13d1ddefa112 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:29.140008 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-016e6047-b9de-4243-aa13-13d1ddefa112 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:29.140460 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-016e6047-b9de-4243-aa13-13d1ddefa112 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:29.140884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-016e6047-b9de-4243-aa13-13d1ddefa112 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:29.319516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-016e6047-b9de-4243-aa13-13d1ddefa112 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:29.323920 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-016e6047-b9de-4243-aa13-13d1ddefa112 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1267 microversion: 2.1 time: 0.196923 Sep 15 07:45:29.324650 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 413/847] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:29 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:29.712540 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7cf240e1-441a-4de0-8cde-170a5f906ca5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:29.713138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7cf240e1-441a-4de0-8cde-170a5f906ca5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:29.719911 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cf240e1-441a-4de0-8cde-170a5f906ca5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:29.720391 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cf240e1-441a-4de0-8cde-170a5f906ca5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:29.720828 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cf240e1-441a-4de0-8cde-170a5f906ca5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:29.721612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cf240e1-441a-4de0-8cde-170a5f906ca5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:29.722091 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cf240e1-441a-4de0-8cde-170a5f906ca5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:29.722480 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7cf240e1-441a-4de0-8cde-170a5f906ca5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:29.865561 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7cf240e1-441a-4de0-8cde-170a5f906ca5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:29.873524 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7cf240e1-441a-4de0-8cde-170a5f906ca5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1575 microversion: 2.1 time: 0.164889 Sep 15 07:45:29.874205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 435/848] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:29 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:30.348989 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a937c323-f95e-45f5-b57e-e29bf043633f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:30.349618 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a937c323-f95e-45f5-b57e-e29bf043633f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:30.356029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a937c323-f95e-45f5-b57e-e29bf043633f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:30.356509 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a937c323-f95e-45f5-b57e-e29bf043633f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:30.359287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a937c323-f95e-45f5-b57e-e29bf043633f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:30.359287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a937c323-f95e-45f5-b57e-e29bf043633f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:30.359287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a937c323-f95e-45f5-b57e-e29bf043633f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:30.359287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a937c323-f95e-45f5-b57e-e29bf043633f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:30.575228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a937c323-f95e-45f5-b57e-e29bf043633f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:30.583709 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a937c323-f95e-45f5-b57e-e29bf043633f tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1454 microversion: 2.1 time: 0.239370 Sep 15 07:45:30.584291 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 414/849] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:30 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1454 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:30.606046 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f488b597-423b-40c2-b60f-5cdce243b524 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:30.606650 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f488b597-423b-40c2-b60f-5cdce243b524 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:30.614775 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f488b597-423b-40c2-b60f-5cdce243b524 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:30.615008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f488b597-423b-40c2-b60f-5cdce243b524 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:30.616018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f488b597-423b-40c2-b60f-5cdce243b524 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:30.616018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f488b597-423b-40c2-b60f-5cdce243b524 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:30.616771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f488b597-423b-40c2-b60f-5cdce243b524 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:30.617092 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f488b597-423b-40c2-b60f-5cdce243b524 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:30.808251 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f488b597-423b-40c2-b60f-5cdce243b524 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:30.812562 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=100 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:30.818364 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f488b597-423b-40c2-b60f-5cdce243b524 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1454 microversion: 2.1 time: 0.216117 Sep 15 07:45:30.819458 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 436/850] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:30 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1454 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:30.898514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6e9417bf-dbc2-43be-bd38-2e13c3742cd3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:30.899126 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6e9417bf-dbc2-43be-bd38-2e13c3742cd3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:30.905415 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6e9417bf-dbc2-43be-bd38-2e13c3742cd3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:30.909156 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6e9417bf-dbc2-43be-bd38-2e13c3742cd3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:30.909156 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6e9417bf-dbc2-43be-bd38-2e13c3742cd3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:30.909156 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6e9417bf-dbc2-43be-bd38-2e13c3742cd3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:30.909156 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6e9417bf-dbc2-43be-bd38-2e13c3742cd3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:30.909700 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6e9417bf-dbc2-43be-bd38-2e13c3742cd3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:30.913615 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:30.930201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-39ece793-4255-41f7-bd70-da26ca7f00f9 req-be43f5ad-6512-4654-bc3f-74e2e1d47c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d61aa0-bcb6-4fe0-bc26-20ef85c5025e", "name": "network-vif-plugged", "status": "completed", "tag": "a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:30.941869 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-39ece793-4255-41f7-bd70-da26ca7f00f9 req-be43f5ad-6512-4654-bc3f-74e2e1d47c58 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:30.942346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-39ece793-4255-41f7-bd70-da26ca7f00f9 req-be43f5ad-6512-4654-bc3f-74e2e1d47c58 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:30.942773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-39ece793-4255-41f7-bd70-da26ca7f00f9 req-be43f5ad-6512-4654-bc3f-74e2e1d47c58 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:30.955275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-39ece793-4255-41f7-bd70-da26ca7f00f9 req-be43f5ad-6512-4654-bc3f-74e2e1d47c58 service nova] Creating event network-vif-plugged:a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14 for instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e on hv-cinder-82414 Sep 15 07:45:30.961171 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-39ece793-4255-41f7-bd70-da26ca7f00f9 req-be43f5ad-6512-4654-bc3f-74e2e1d47c58 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035237 Sep 15 07:45:30.962219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 437/851] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:45:31.066756 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6e9417bf-dbc2-43be-bd38-2e13c3742cd3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:31.083269 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6e9417bf-dbc2-43be-bd38-2e13c3742cd3 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1575 microversion: 2.1 time: 0.188973 Sep 15 07:45:31.084160 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 415/852] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:30 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:32.108769 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c90a6b54-8880-4329-b913-ec873dab5c69 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:32.109544 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c90a6b54-8880-4329-b913-ec873dab5c69 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:32.117591 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c90a6b54-8880-4329-b913-ec873dab5c69 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:32.123964 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c90a6b54-8880-4329-b913-ec873dab5c69 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:32.123964 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c90a6b54-8880-4329-b913-ec873dab5c69 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:32.123964 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c90a6b54-8880-4329-b913-ec873dab5c69 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:32.123964 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c90a6b54-8880-4329-b913-ec873dab5c69 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:32.124357 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c90a6b54-8880-4329-b913-ec873dab5c69 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:32.265051 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c90a6b54-8880-4329-b913-ec873dab5c69 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:32.275106 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c90a6b54-8880-4329-b913-ec873dab5c69 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1575 microversion: 2.1 time: 0.170582 Sep 15 07:45:32.276242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 438/853] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:32 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:45:33.020778 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-6c3c74b9-fa01-414e-a5b7-63e9c160fa50 req-9d937707-e11e-40b8-adab-b7ecdfe601a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbef2c3-07c4-4165-b994-cf399a858379", "tag": "3f042454-cf32-4a00-ae9e-6827217983a6"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:33.032509 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-6c3c74b9-fa01-414e-a5b7-63e9c160fa50 req-9d937707-e11e-40b8-adab-b7ecdfe601a5 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:33.032988 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-6c3c74b9-fa01-414e-a5b7-63e9c160fa50 req-9d937707-e11e-40b8-adab-b7ecdfe601a5 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:33.034124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-6c3c74b9-fa01-414e-a5b7-63e9c160fa50 req-9d937707-e11e-40b8-adab-b7ecdfe601a5 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:33.044811 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-6c3c74b9-fa01-414e-a5b7-63e9c160fa50 req-9d937707-e11e-40b8-adab-b7ecdfe601a5 service nova] Creating event network-changed:3f042454-cf32-4a00-ae9e-6827217983a6 for instance fbbef2c3-07c4-4165-b994-cf399a858379 on hv-cinder-82414 Sep 15 07:45:33.049939 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-6c3c74b9-fa01-414e-a5b7-63e9c160fa50 req-9d937707-e11e-40b8-adab-b7ecdfe601a5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033663 Sep 15 07:45:33.050729 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 416/854] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:45:33.300494 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-53a581fc-d7c9-4cbb-8074-dd1c4e365eb1 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:33.301868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-53a581fc-d7c9-4cbb-8074-dd1c4e365eb1 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:33.309433 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-53a581fc-d7c9-4cbb-8074-dd1c4e365eb1 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:33.310399 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-53a581fc-d7c9-4cbb-8074-dd1c4e365eb1 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:33.317119 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-53a581fc-d7c9-4cbb-8074-dd1c4e365eb1 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:33.317119 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-53a581fc-d7c9-4cbb-8074-dd1c4e365eb1 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:33.317119 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-53a581fc-d7c9-4cbb-8074-dd1c4e365eb1 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:33.317119 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-53a581fc-d7c9-4cbb-8074-dd1c4e365eb1 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:33.532842 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-53a581fc-d7c9-4cbb-8074-dd1c4e365eb1 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:33.541818 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-53a581fc-d7c9-4cbb-8074-dd1c4e365eb1 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1562 microversion: 2.1 time: 0.245876 Sep 15 07:45:33.542525 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 439/855] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:45:33 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1562 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:41.928570 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-50a0e800-1ad9-4efb-a623-41f11fb98bf7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:41.931121 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-50a0e800-1ad9-4efb-a623-41f11fb98bf7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:41.933197 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:41.938680 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50a0e800-1ad9-4efb-a623-41f11fb98bf7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:41.939263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50a0e800-1ad9-4efb-a623-41f11fb98bf7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:41.939935 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50a0e800-1ad9-4efb-a623-41f11fb98bf7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:41.942073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50a0e800-1ad9-4efb-a623-41f11fb98bf7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:41.942073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50a0e800-1ad9-4efb-a623-41f11fb98bf7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:41.942073 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-50a0e800-1ad9-4efb-a623-41f11fb98bf7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:41.975655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-50a0e800-1ad9-4efb-a623-41f11fb98bf7 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053372 Sep 15 07:45:41.976257 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 417/856] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 15 07:45:41 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:45:42.046288 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-219a8d5e-9127-475e-be32-e5db7ca32f03 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:42.046858 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-219a8d5e-9127-475e-be32-e5db7ca32f03 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:42.054678 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-219a8d5e-9127-475e-be32-e5db7ca32f03 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:42.055177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-219a8d5e-9127-475e-be32-e5db7ca32f03 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:42.055621 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-219a8d5e-9127-475e-be32-e5db7ca32f03 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:42.056327 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-219a8d5e-9127-475e-be32-e5db7ca32f03 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:42.056795 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-219a8d5e-9127-475e-be32-e5db7ca32f03 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:42.057208 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-219a8d5e-9127-475e-be32-e5db7ca32f03 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:42.086649 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-219a8d5e-9127-475e-be32-e5db7ca32f03 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:45:42.344151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-219a8d5e-9127-475e-be32-e5db7ca32f03 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 204 len: 0 microversion: 2.20 time: 0.301470 Sep 15 07:45:42.344712 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 440/857] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 15 07:45:42 2022] DELETE /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 07:45:42.353967 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:42.354578 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:42.360825 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:42.362098 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:42.362647 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:42.363332 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:42.363784 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:42.364209 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:42.720315 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:42.728602 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:42.730082 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:42.731258 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d943ec53-1782-4b16-8c45-068494f4ecac tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.381586 Sep 15 07:45:42.731819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 418/858] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:42 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:45:43.757928 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:43.758634 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:43.764952 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:43.765434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:43.765909 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:43.766594 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:43.768260 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:43.768695 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:43.901779 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:43.910120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:43.911643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:43.912807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-79c6a7fa-cd9f-4e57-a451-29b7d05ca267 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1722 microversion: 2.20 time: 0.159236 Sep 15 07:45:43.913350 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 441/859] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:43 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:45:44.938738 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:44.939751 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:44.948623 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:44.949201 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:44.949806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:44.952028 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:44.952028 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:44.952028 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:45.022936 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:45.035108 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:45.037078 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:45.038891 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6454c18a-7806-4d64-9f4c-91da23ed5c08 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1654 microversion: 2.20 time: 0.103852 Sep 15 07:45:45.039931 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 419/860] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:44 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1654 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 07:45:45.068380 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-8f23a90c-b5d3-425f-9c4b-4bdcf742099b req-d8c821a5-89b6-4444-b79d-66cef640812a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f14c845-5f86-4d74-8813-e7c482a6be08", "name": "network-vif-deleted", "tag": "2f98d201-6410-4508-a7f3-40ecd7daed4f"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:45:45.092847 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-8f23a90c-b5d3-425f-9c4b-4bdcf742099b req-d8c821a5-89b6-4444-b79d-66cef640812a service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:45.093849 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-8f23a90c-b5d3-425f-9c4b-4bdcf742099b req-d8c821a5-89b6-4444-b79d-66cef640812a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:45.095654 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-8f23a90c-b5d3-425f-9c4b-4bdcf742099b req-d8c821a5-89b6-4444-b79d-66cef640812a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:45.110111 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-8f23a90c-b5d3-425f-9c4b-4bdcf742099b req-d8c821a5-89b6-4444-b79d-66cef640812a service nova] Creating event network-vif-deleted:2f98d201-6410-4508-a7f3-40ecd7daed4f for instance 0f14c845-5f86-4d74-8813-e7c482a6be08 on hv-cinder-82414 Sep 15 07:45:45.117240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-8f23a90c-b5d3-425f-9c4b-4bdcf742099b req-d8c821a5-89b6-4444-b79d-66cef640812a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052927 Sep 15 07:45:45.118199 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 442/861] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:45:46.064625 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:46.065498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:46.074352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:46.074911 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:46.083559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:46.083559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:46.083559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:46.083559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:46.116758 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:46.117674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:46.118272 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:46.118883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lazy-loading 'fault' on Instance uuid 0f14c845-5f86-4d74-8813-e7c482a6be08 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:45:46.196718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:46.218661 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:46.220915 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '56c2f854cf074b1ba2571766b7f2fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a8f2664964492e9c80a595ed043c71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:45:46.225945 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-30883e5c-94de-4571-98df-46f814cac313 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 200 len: 1370 microversion: 2.20 time: 0.165232 Sep 15 07:45:46.240357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 420/862] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:46 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 07:45:47.253765 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:47.254525 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:47.261397 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:47.261873 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:47.262314 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:47.263039 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:47.263501 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:47.263929 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:47.278037 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] HTTP exception thrown: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Request method failure captured: Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 HTTP/1.1 Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaHrqBR6jSRpxwpKo9b0BSB0acQf1s18cMemrxh_psM8wYgLWn0tT0A0_Tzcowhkz5_TsC4P50hY7avW225VRdj8qMfj6Ngk5xRLN7x2r4HYn1iIRCXiGkc4-u37AFRJ_46JPo9zOrQ_Flnu5DrBRNBarwnDuSx_c5UOoc5qYbkvvY Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:45:47.279727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4a8f2664964492e9c80a595ed043c71"}]}] Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 56c2f854cf074b1ba2571766b7f2fc51 Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:47.281500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '0f14c845-5f86-4d74-8813-e7c482a6be08'} Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:47.287843 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:47.289466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:47.290871 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Returning 404 to user: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:47.290871 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ef3d4ca0-09fe-4fa4-a832-71f2191b0ac3 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 404 len: 111 microversion: 2.20 time: 0.031801 Sep 15 07:45:47.290871 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 443/863] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:47 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 07:45:47.291123 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-16a39ea9-fb31-4d75-9ca2-6bedc8485dce tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '.version_select at 0x7ff36c8965e0>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:47.349404 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-16a39ea9-fb31-4d75-9ca2-6bedc8485dce tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-987283050" status: 204 len: 0 microversion: 2.20 time: 0.062459 Sep 15 07:45:47.350044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 421/864] 10.222.0.42 () {60 vars in 1259 bytes} [Thu Sep 15 07:45:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-987283050 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 15 07:45:49.388145 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:49.388145 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:49.394857 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:49.395351 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:49.395793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:49.396495 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:49.396953 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:49.397444 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:49.410984 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] HTTP exception thrown: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Request method failure captured: Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: DELETE /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 HTTP/1.1 Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaHrqBR6jSRpxwpKo9b0BSB0acQf1s18cMemrxh_psM8wYgLWn0tT0A0_Tzcowhkz5_TsC4P50hY7avW225VRdj8qMfj6Ngk5xRLN7x2r4HYn1iIRCXiGkc4-u37AFRJ_46JPo9zOrQ_Flnu5DrBRNBarwnDuSx_c5UOoc5qYbkvvY Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:45:49.413015 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4a8f2664964492e9c80a595ed043c71"}]}] Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 56c2f854cf074b1ba2571766b7f2fc51 Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:49.414912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '0f14c845-5f86-4d74-8813-e7c482a6be08'} Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:49.415868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:49.417368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:49.418969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Returning 404 to user: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:49.418969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6a82939d-9997-47dc-93c7-94c83afa9b1c tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 404 len: 111 microversion: 2.20 time: 0.031175 Sep 15 07:45:49.418969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 444/865] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 15 07:45:49 2022] DELETE /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 07:45:49.423747 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:49.424376 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 0f14c845-5f86-4d74-8813-e7c482a6be08] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:49.433670 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:49.433670 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:49.433670 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:49.433670 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:49.434101 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:49.434101 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:49.447577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] HTTP exception thrown: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Request method failure captured: Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 HTTP/1.1 Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaHrqBR6jSRpxwpKo9b0BSB0acQf1s18cMemrxh_psM8wYgLWn0tT0A0_Tzcowhkz5_TsC4P50hY7avW225VRdj8qMfj6Ngk5xRLN7x2r4HYn1iIRCXiGkc4-u37AFRJ_46JPo9zOrQ_Flnu5DrBRNBarwnDuSx_c5UOoc5qYbkvvY Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:45:49.449248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4a8f2664964492e9c80a595ed043c71"}]}] Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 56c2f854cf074b1ba2571766b7f2fc51 Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:49.452210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '0f14c845-5f86-4d74-8813-e7c482a6be08'} Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:49.453011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. Sep 15 07:45:49.454396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:49.455599 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Returning 404 to user: Instance 0f14c845-5f86-4d74-8813-e7c482a6be08 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:49.455599 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0a8eef34-94ab-4d98-878d-55b2d1e97785 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08" status: 404 len: 111 microversion: 2.20 time: 0.031975 Sep 15 07:45:49.455599 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 422/866] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:49 2022] GET /compute/v2.1/servers/0f14c845-5f86-4d74-8813-e7c482a6be08 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 15 07:45:52.819523 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:52.819523 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:52.819523 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:45:52.824120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:52.824656 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:52.825095 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:52.825814 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:52.826272 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:52.826700 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:52.840736 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] HTTP exception thrown: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Request method failure captured: Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: DELETE /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 HTTP/1.1 Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItaHrqBR6jSRpxwpKo9b0BSB0acQf1s18cMemrxh_psM8wYgLWn0tT0A0_Tzcowhkz5_TsC4P50hY7avW225VRdj8qMfj6Ngk5xRLN7x2r4HYn1iIRCXiGkc4-u37AFRJ_46JPo9zOrQ_Flnu5DrBRNBarwnDuSx_c5UOoc5qYbkvvY Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:45:52.842295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4a8f2664964492e9c80a595ed043c71"}]}] Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 56c2f854cf074b1ba2571766b7f2fc51 Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:45:52.848244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '07ae2103-9abb-45d7-94b1-7e0f83c44fa0'} Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:52.849022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:45:52.850257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:45:52.851464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Returning 404 to user: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:52.851464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d00eac2e-8078-476f-a54d-820ca0a6c6aa tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "DELETE /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 404 len: 111 microversion: 2.20 time: 0.031671 Sep 15 07:45:52.851464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 445/867] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 15 07:45:52 2022] DELETE /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 07:45:52.852753 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:45:52.853409 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] [instance: 07ae2103-9abb-45d7-94b1-7e0f83c44fa0] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:45:52.861333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:52.861873 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:52.862305 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:52.863121 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:45:52.863573 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:45:52.863994 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:45:52.878512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] HTTP exception thrown: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Request method failure captured: Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 HTTP/1.1 Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItaHrqBR6jSRpxwpKo9b0BSB0acQf1s18cMemrxh_psM8wYgLWn0tT0A0_Tzcowhkz5_TsC4P50hY7avW225VRdj8qMfj6Ngk5xRLN7x2r4HYn1iIRCXiGkc4-u37AFRJ_46JPo9zOrQ_Flnu5DrBRNBarwnDuSx_c5UOoc5qYbkvvY Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Openstack-Nova-Api-Version: 2.20 Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:45:52.879561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b4a8f2664964492e9c80a595ed043c71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b4a8f2664964492e9c80a595ed043c71"}]}] Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: b4a8f2664964492e9c80a595ed043c71 Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887792034 Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 56c2f854cf074b1ba2571766b7f2fc51 Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887792034-project Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:45:52.881179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '07ae2103-9abb-45d7-94b1-7e0f83c44fa0'} Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:45:52.882238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. Sep 15 07:45:52.883481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:45:52.884563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] Returning 404 to user: Instance 07ae2103-9abb-45d7-94b1-7e0f83c44fa0 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:45:52.884563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ab48faee-91df-4138-bb76-f2a31a5aa073 tempest-AttachVolumeShelveTestJSON-1887792034 tempest-AttachVolumeShelveTestJSON-1887792034-project] 10.222.0.42 "GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0" status: 404 len: 111 microversion: 2.20 time: 0.032310 Sep 15 07:45:52.884563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 423/868] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 15 07:45:52 2022] GET /compute/v2.1/servers/07ae2103-9abb-45d7-94b1-7e0f83c44fa0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 15 07:46:04.287705 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:04.420504 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-52a7e33b-9319-48bf-b30d-0a898080348e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Action: 'create', calling method: .version_select at 0x7ff37019d790>, body: {"keypair": {"name": "tempest-keypair-148655227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnZJKQA3DnCS+t9po3UtIQ6OLvRjgjViJbEWlu1cQE3A91h6ylj8oJDmLE/t2MPL3MEUkmoIeI7TKRZqbKqe2RDDLgoX2oHFS81oQNbe2NDDyD2HWC60DKv25/AlDFk9A=="}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:46:04.438078 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-52a7e33b-9319-48bf-b30d-0a898080348e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Getting quotas for project a9d0f5e6d6cf423485157e1381a12713. Resources: {'key_pairs'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:46:04.442286 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-52a7e33b-9319-48bf-b30d-0a898080348e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Getting quotas for user f8022d5f904e4ae294b2cdf21aa11212 and project a9d0f5e6d6cf423485157e1381a12713. Resources: {'key_pairs'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:46:04.530697 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-52a7e33b-9319-48bf-b30d-0a898080348e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.247793 Sep 15 07:46:04.531294 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 446/869] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 15 07:46:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:46:06.940882 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-760856989", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a516fb80-088a-420e-bbe2-327bfb75896d"}], "security_groups": [{"name": "tempest-securitygroup--1311928287"}], "key_name": "tempest-keypair-148655227", "user_data": "}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:46:06.956795 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:06.957722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=37 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:07.066812 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] validate_networks() for [('a516fb80-088a-420e-bbe2-327bfb75896d', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:46:07.531522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:46:07.531953 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:46:07.532421 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:46:07.532825 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:46:07.533230 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:46:07.542545 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:07.543275 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:07.543798 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:07.544548 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:07.545051 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:07.545481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:07.564079 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Getting quotas for project a9d0f5e6d6cf423485157e1381a12713. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:46:07.568481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Getting quotas for user f8022d5f904e4ae294b2cdf21aa11212 and project a9d0f5e6d6cf423485157e1381a12713. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:46:07.581290 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:46:07.583694 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:46:07.725513 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a7ba18e5-f558-495b-bdd8-94cbf570cd09 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.790048 Sep 15 07:46:07.726200 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 424/870] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:46:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:46:07.737848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2ae2bab7-c97b-4f9f-a960-66538d0bfa8a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:07.738471 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2ae2bab7-c97b-4f9f-a960-66538d0bfa8a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:07.798590 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2ae2bab7-c97b-4f9f-a960-66538d0bfa8a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:07.805657 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2ae2bab7-c97b-4f9f-a960-66538d0bfa8a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1236 microversion: 2.1 time: 0.071829 Sep 15 07:46:07.806222 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 447/871] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:07 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:08.829956 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a295296f-8eb8-4437-beb1-eeb0047ae3ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:08.830570 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a295296f-8eb8-4437-beb1-eeb0047ae3ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:08.840933 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a295296f-8eb8-4437-beb1-eeb0047ae3ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:08.841702 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a295296f-8eb8-4437-beb1-eeb0047ae3ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:08.842468 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a295296f-8eb8-4437-beb1-eeb0047ae3ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:08.843487 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a295296f-8eb8-4437-beb1-eeb0047ae3ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:08.844092 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a295296f-8eb8-4437-beb1-eeb0047ae3ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:08.844574 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a295296f-8eb8-4437-beb1-eeb0047ae3ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:08.909415 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a295296f-8eb8-4437-beb1-eeb0047ae3ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:08.916975 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a295296f-8eb8-4437-beb1-eeb0047ae3ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1240 microversion: 2.1 time: 0.091472 Sep 15 07:46:08.917638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 425/872] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:08 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:09.941104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9355a1d6-f96b-493f-8c1b-0dc5ba95a2bb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:09.941844 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9355a1d6-f96b-493f-8c1b-0dc5ba95a2bb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:09.948709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9355a1d6-f96b-493f-8c1b-0dc5ba95a2bb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:09.949271 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9355a1d6-f96b-493f-8c1b-0dc5ba95a2bb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:09.949985 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9355a1d6-f96b-493f-8c1b-0dc5ba95a2bb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:09.951041 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9355a1d6-f96b-493f-8c1b-0dc5ba95a2bb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:09.951889 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9355a1d6-f96b-493f-8c1b-0dc5ba95a2bb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:09.952615 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9355a1d6-f96b-493f-8c1b-0dc5ba95a2bb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:10.020240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9355a1d6-f96b-493f-8c1b-0dc5ba95a2bb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:10.029368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9355a1d6-f96b-493f-8c1b-0dc5ba95a2bb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1288 microversion: 2.1 time: 0.090536 Sep 15 07:46:10.029368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 448/873] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:09 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:46:11.051796 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c85ad817-4f00-4336-b108-52759ca2182a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:11.052407 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c85ad817-4f00-4336-b108-52759ca2182a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:11.061779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c85ad817-4f00-4336-b108-52759ca2182a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:11.061779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c85ad817-4f00-4336-b108-52759ca2182a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:11.061779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c85ad817-4f00-4336-b108-52759ca2182a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:11.062932 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c85ad817-4f00-4336-b108-52759ca2182a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:11.063672 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c85ad817-4f00-4336-b108-52759ca2182a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:11.064137 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c85ad817-4f00-4336-b108-52759ca2182a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:11.236487 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c85ad817-4f00-4336-b108-52759ca2182a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:11.245086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c85ad817-4f00-4336-b108-52759ca2182a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1362 microversion: 2.1 time: 0.197087 Sep 15 07:46:11.245679 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 426/874] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:11 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:11.969569 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-4e190d2c-0c29-4979-a21e-c4b7e44c0185 req-a1d0590e-d241-47c9-9ff4-ca1f8c4009c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30ed5535-17bd-48d9-b6b5-ba296066b7ec", "tag": "6e5a7191-bf35-416a-9367-9584add6f1b5"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:46:11.979908 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4e190d2c-0c29-4979-a21e-c4b7e44c0185 req-a1d0590e-d241-47c9-9ff4-ca1f8c4009c0 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:11.980369 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4e190d2c-0c29-4979-a21e-c4b7e44c0185 req-a1d0590e-d241-47c9-9ff4-ca1f8c4009c0 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:11.980804 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-4e190d2c-0c29-4979-a21e-c4b7e44c0185 req-a1d0590e-d241-47c9-9ff4-ca1f8c4009c0 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:11.992436 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-4e190d2c-0c29-4979-a21e-c4b7e44c0185 req-a1d0590e-d241-47c9-9ff4-ca1f8c4009c0 service nova] Creating event network-changed:6e5a7191-bf35-416a-9367-9584add6f1b5 for instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec on hv-cinder-82414 Sep 15 07:46:11.997460 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-4e190d2c-0c29-4979-a21e-c4b7e44c0185 req-a1d0590e-d241-47c9-9ff4-ca1f8c4009c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032044 Sep 15 07:46:11.998384 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 449/875] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:46:12.268387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3aa770fc-0014-498b-a7ef-f7e934c7f089 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:12.268991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3aa770fc-0014-498b-a7ef-f7e934c7f089 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:12.288498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3aa770fc-0014-498b-a7ef-f7e934c7f089 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:12.289242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3aa770fc-0014-498b-a7ef-f7e934c7f089 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:12.291137 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3aa770fc-0014-498b-a7ef-f7e934c7f089 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:12.292121 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3aa770fc-0014-498b-a7ef-f7e934c7f089 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:12.293711 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3aa770fc-0014-498b-a7ef-f7e934c7f089 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:12.297282 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3aa770fc-0014-498b-a7ef-f7e934c7f089 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:12.480672 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3aa770fc-0014-498b-a7ef-f7e934c7f089 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:12.490067 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3aa770fc-0014-498b-a7ef-f7e934c7f089 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1362 microversion: 2.1 time: 0.225449 Sep 15 07:46:12.491214 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 427/876] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:12 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:13.515411 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-84d29e64-1057-4503-a216-20116bf81e4a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:13.516104 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-84d29e64-1057-4503-a216-20116bf81e4a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:13.522421 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-84d29e64-1057-4503-a216-20116bf81e4a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:13.522903 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-84d29e64-1057-4503-a216-20116bf81e4a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:13.523336 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-84d29e64-1057-4503-a216-20116bf81e4a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:13.524737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-84d29e64-1057-4503-a216-20116bf81e4a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:13.524737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-84d29e64-1057-4503-a216-20116bf81e4a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:13.524959 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-84d29e64-1057-4503-a216-20116bf81e4a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:13.680462 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-84d29e64-1057-4503-a216-20116bf81e4a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:13.688219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-84d29e64-1057-4503-a216-20116bf81e4a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1362 microversion: 2.1 time: 0.178001 Sep 15 07:46:13.688791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 450/877] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:13 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:14.712827 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f076e849-1475-48fb-aa1c-e445d241f98c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:14.713859 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f076e849-1475-48fb-aa1c-e445d241f98c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:14.722076 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f076e849-1475-48fb-aa1c-e445d241f98c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:14.722840 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f076e849-1475-48fb-aa1c-e445d241f98c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:14.723497 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f076e849-1475-48fb-aa1c-e445d241f98c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:14.724533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f076e849-1475-48fb-aa1c-e445d241f98c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:14.725208 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f076e849-1475-48fb-aa1c-e445d241f98c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:14.725892 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f076e849-1475-48fb-aa1c-e445d241f98c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:14.862002 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f076e849-1475-48fb-aa1c-e445d241f98c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:14.870344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f076e849-1475-48fb-aa1c-e445d241f98c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1362 microversion: 2.1 time: 0.161676 Sep 15 07:46:14.871156 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 428/878] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:14 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:15.893405 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-820a4005-f387-45bb-bdb7-097a9b3f50e8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:15.894055 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-820a4005-f387-45bb-bdb7-097a9b3f50e8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:15.900436 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-820a4005-f387-45bb-bdb7-097a9b3f50e8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:15.900916 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-820a4005-f387-45bb-bdb7-097a9b3f50e8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:15.901351 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-820a4005-f387-45bb-bdb7-097a9b3f50e8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:15.902075 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-820a4005-f387-45bb-bdb7-097a9b3f50e8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:15.902522 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-820a4005-f387-45bb-bdb7-097a9b3f50e8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:15.902940 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-820a4005-f387-45bb-bdb7-097a9b3f50e8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:16.058530 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-820a4005-f387-45bb-bdb7-097a9b3f50e8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:16.066786 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-820a4005-f387-45bb-bdb7-097a9b3f50e8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1362 microversion: 2.1 time: 0.177196 Sep 15 07:46:16.067515 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 451/879] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:15 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:17.093384 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2b3a2595-5192-4a6a-a1dd-a4565cf8e888 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:17.094022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2b3a2595-5192-4a6a-a1dd-a4565cf8e888 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:17.100423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b3a2595-5192-4a6a-a1dd-a4565cf8e888 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:17.100907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b3a2595-5192-4a6a-a1dd-a4565cf8e888 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:17.101342 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b3a2595-5192-4a6a-a1dd-a4565cf8e888 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:17.102128 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b3a2595-5192-4a6a-a1dd-a4565cf8e888 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:17.102586 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b3a2595-5192-4a6a-a1dd-a4565cf8e888 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:17.108568 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b3a2595-5192-4a6a-a1dd-a4565cf8e888 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:17.232537 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-2b3a2595-5192-4a6a-a1dd-a4565cf8e888 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:17.240141 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2b3a2595-5192-4a6a-a1dd-a4565cf8e888 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1362 microversion: 2.1 time: 0.151200 Sep 15 07:46:17.240702 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 429/880] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:17 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:17.752135 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-eadfe539-3db3-4f23-8485-23cc82e144f6 req-77c5ca85-1291-4ba7-ac29-d1366253cebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ed5535-17bd-48d9-b6b5-ba296066b7ec", "name": "network-vif-plugged", "status": "completed", "tag": "6e5a7191-bf35-416a-9367-9584add6f1b5"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:46:17.767441 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-eadfe539-3db3-4f23-8485-23cc82e144f6 req-77c5ca85-1291-4ba7-ac29-d1366253cebf service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:17.767914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-eadfe539-3db3-4f23-8485-23cc82e144f6 req-77c5ca85-1291-4ba7-ac29-d1366253cebf service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:17.769730 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-eadfe539-3db3-4f23-8485-23cc82e144f6 req-77c5ca85-1291-4ba7-ac29-d1366253cebf service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:17.784513 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-eadfe539-3db3-4f23-8485-23cc82e144f6 req-77c5ca85-1291-4ba7-ac29-d1366253cebf service nova] Creating event network-vif-plugged:6e5a7191-bf35-416a-9367-9584add6f1b5 for instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec on hv-cinder-82414 Sep 15 07:46:17.785748 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-eadfe539-3db3-4f23-8485-23cc82e144f6 req-77c5ca85-1291-4ba7-ac29-d1366253cebf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037570 Sep 15 07:46:17.786321 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 452/881] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:46:18.264043 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-845768f8-c5a2-4fd8-8fd3-f60ea298031f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:18.264647 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-845768f8-c5a2-4fd8-8fd3-f60ea298031f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:18.266521 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:18.267189 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=6 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:18.272327 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-845768f8-c5a2-4fd8-8fd3-f60ea298031f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:18.272858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-845768f8-c5a2-4fd8-8fd3-f60ea298031f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:18.273289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-845768f8-c5a2-4fd8-8fd3-f60ea298031f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:18.274004 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-845768f8-c5a2-4fd8-8fd3-f60ea298031f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:18.274450 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-845768f8-c5a2-4fd8-8fd3-f60ea298031f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:18.274925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-845768f8-c5a2-4fd8-8fd3-f60ea298031f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:18.410221 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-845768f8-c5a2-4fd8-8fd3-f60ea298031f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:18.418201 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-845768f8-c5a2-4fd8-8fd3-f60ea298031f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1362 microversion: 2.1 time: 0.158758 Sep 15 07:46:18.418771 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 430/882] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:18 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:19.438802 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=6 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:19.447481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a9aa5243-352b-4961-9be5-7a0948700afa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:19.447481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a9aa5243-352b-4961-9be5-7a0948700afa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:19.450598 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a9aa5243-352b-4961-9be5-7a0948700afa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:19.451031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a9aa5243-352b-4961-9be5-7a0948700afa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:19.451983 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a9aa5243-352b-4961-9be5-7a0948700afa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:19.452728 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a9aa5243-352b-4961-9be5-7a0948700afa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:19.453212 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a9aa5243-352b-4961-9be5-7a0948700afa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:19.453664 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a9aa5243-352b-4961-9be5-7a0948700afa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:19.592615 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a9aa5243-352b-4961-9be5-7a0948700afa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:19.601248 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a9aa5243-352b-4961-9be5-7a0948700afa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1549 microversion: 2.1 time: 0.163311 Sep 15 07:46:19.601852 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 453/883] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:19 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:46:19.624656 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7a2e8d72-284e-4a00-8843-91707e8616fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:19.625158 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7a2e8d72-284e-4a00-8843-91707e8616fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:19.632946 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a2e8d72-284e-4a00-8843-91707e8616fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:19.633817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a2e8d72-284e-4a00-8843-91707e8616fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:19.634267 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a2e8d72-284e-4a00-8843-91707e8616fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:19.635075 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a2e8d72-284e-4a00-8843-91707e8616fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:19.635537 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a2e8d72-284e-4a00-8843-91707e8616fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:19.635974 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a2e8d72-284e-4a00-8843-91707e8616fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:19.720331 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7a2e8d72-284e-4a00-8843-91707e8616fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099960 Sep 15 07:46:19.720979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 431/884] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 15 07:46:19 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:46:21.007877 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-f3c38c05-e859-48df-a28a-d7c5a4ce3626 req-a4f42ac0-411c-4871-9235-2f52e8d9409d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30ed5535-17bd-48d9-b6b5-ba296066b7ec", "tag": "6e5a7191-bf35-416a-9367-9584add6f1b5"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:46:21.026531 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f3c38c05-e859-48df-a28a-d7c5a4ce3626 req-a4f42ac0-411c-4871-9235-2f52e8d9409d service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:21.026531 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f3c38c05-e859-48df-a28a-d7c5a4ce3626 req-a4f42ac0-411c-4871-9235-2f52e8d9409d service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:21.027072 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f3c38c05-e859-48df-a28a-d7c5a4ce3626 req-a4f42ac0-411c-4871-9235-2f52e8d9409d service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:21.046582 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-f3c38c05-e859-48df-a28a-d7c5a4ce3626 req-a4f42ac0-411c-4871-9235-2f52e8d9409d service nova] Creating event network-changed:6e5a7191-bf35-416a-9367-9584add6f1b5 for instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec on hv-cinder-82414 Sep 15 07:46:21.068966 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-f3c38c05-e859-48df-a28a-d7c5a4ce3626 req-a4f42ac0-411c-4871-9235-2f52e8d9409d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067938 Sep 15 07:46:21.070872 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 454/885] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:46:44.720207 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:44.721412 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=42 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:44.725503 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1231786723", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "networks": [{"uuid": "6566ac70-70ae-4e19-b0b8-45ffeb54dc33"}]}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:46:44.780694 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] validate_networks() for [('6566ac70-70ae-4e19-b0b8-45ffeb54dc33', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:46:45.142419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:46:45.142841 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:46:45.143367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:46:45.143772 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:46:45.144178 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:46:45.153406 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:45.153934 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:45.154365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:45.155084 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:45.155530 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:45.155944 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:45.172802 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Getting quotas for project 988cf6a6fa2b452e8c4c017f282d144c. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:46:45.176582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Getting quotas for user 4d66f4fd90e74287ae9891e0364ab2cd and project 988cf6a6fa2b452e8c4c017f282d144c. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:46:45.187423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:46:45.189521 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:46:45.328240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-294d5069-0f47-4768-a3c6-5b2d03656c44 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609042 Sep 15 07:46:45.328890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 432/886] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:46:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:46:45.341325 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c0e065ae-9ca5-4007-9f01-9c514a257cbb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:45.342142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c0e065ae-9ca5-4007-9f01-9c514a257cbb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:45.345276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:45.346193 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=30 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:45.399153 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c0e065ae-9ca5-4007-9f01-9c514a257cbb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:45.407290 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c0e065ae-9ca5-4007-9f01-9c514a257cbb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1214 microversion: 2.1 time: 0.070936 Sep 15 07:46:45.410440 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 455/887] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:45 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:46.430142 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-813a726e-d438-46a9-b460-d612fd23305c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:46.430754 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-813a726e-d438-46a9-b460-d612fd23305c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:46.437865 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-813a726e-d438-46a9-b460-d612fd23305c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:46.438347 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-813a726e-d438-46a9-b460-d612fd23305c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:46.438781 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-813a726e-d438-46a9-b460-d612fd23305c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:46.440356 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-813a726e-d438-46a9-b460-d612fd23305c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:46.440848 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-813a726e-d438-46a9-b460-d612fd23305c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:46.441278 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-813a726e-d438-46a9-b460-d612fd23305c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:46.505886 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-813a726e-d438-46a9-b460-d612fd23305c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:46.515045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-813a726e-d438-46a9-b460-d612fd23305c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1218 microversion: 2.1 time: 0.088709 Sep 15 07:46:46.515637 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 433/888] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:46 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:47.538317 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2639665b-2c41-4162-ad0e-825c02272b15 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:47.539656 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2639665b-2c41-4162-ad0e-825c02272b15 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:47.548737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2639665b-2c41-4162-ad0e-825c02272b15 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:47.549217 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2639665b-2c41-4162-ad0e-825c02272b15 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:47.549725 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2639665b-2c41-4162-ad0e-825c02272b15 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:47.552994 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2639665b-2c41-4162-ad0e-825c02272b15 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:47.552994 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2639665b-2c41-4162-ad0e-825c02272b15 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:47.552994 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2639665b-2c41-4162-ad0e-825c02272b15 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:47.615827 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2639665b-2c41-4162-ad0e-825c02272b15 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:47.624140 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2639665b-2c41-4162-ad0e-825c02272b15 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1266 microversion: 2.1 time: 0.089612 Sep 15 07:46:47.624699 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 456/889] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:47 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:48.647363 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e75bbd67-3d36-45e0-beed-ee6f84b2f6cb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:48.648002 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e75bbd67-3d36-45e0-beed-ee6f84b2f6cb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:48.654956 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e75bbd67-3d36-45e0-beed-ee6f84b2f6cb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:48.655435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e75bbd67-3d36-45e0-beed-ee6f84b2f6cb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:48.655863 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e75bbd67-3d36-45e0-beed-ee6f84b2f6cb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:48.656548 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e75bbd67-3d36-45e0-beed-ee6f84b2f6cb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:48.656995 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e75bbd67-3d36-45e0-beed-ee6f84b2f6cb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:48.657410 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e75bbd67-3d36-45e0-beed-ee6f84b2f6cb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:48.724597 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e75bbd67-3d36-45e0-beed-ee6f84b2f6cb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:48.732255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e75bbd67-3d36-45e0-beed-ee6f84b2f6cb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1272 microversion: 2.1 time: 0.088674 Sep 15 07:46:48.732839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 434/890] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:48 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:49.756625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f5e9afb9-8ea8-4e1d-80b0-88bc035250bc tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:49.757174 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f5e9afb9-8ea8-4e1d-80b0-88bc035250bc tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:49.765624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f5e9afb9-8ea8-4e1d-80b0-88bc035250bc tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:49.766426 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f5e9afb9-8ea8-4e1d-80b0-88bc035250bc tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:49.770263 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f5e9afb9-8ea8-4e1d-80b0-88bc035250bc tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:49.770263 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f5e9afb9-8ea8-4e1d-80b0-88bc035250bc tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:49.770263 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f5e9afb9-8ea8-4e1d-80b0-88bc035250bc tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:49.770263 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f5e9afb9-8ea8-4e1d-80b0-88bc035250bc tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:49.938077 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f5e9afb9-8ea8-4e1d-80b0-88bc035250bc tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:49.947332 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f5e9afb9-8ea8-4e1d-80b0-88bc035250bc tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1314 microversion: 2.1 time: 0.194617 Sep 15 07:46:49.947922 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 457/891] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:49 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:50.147009 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-a2cf9c59-a2ea-406f-92c8-829f9e22e207 req-d9cd1068-dfcb-47e5-999e-9a152eade56b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a875e416-cd4f-4ef4-b5f3-f9e1174ff843", "tag": "b478792f-ef04-4e67-9b7d-7f28eaf19a2d"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:46:50.157085 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-a2cf9c59-a2ea-406f-92c8-829f9e22e207 req-d9cd1068-dfcb-47e5-999e-9a152eade56b service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:50.157563 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-a2cf9c59-a2ea-406f-92c8-829f9e22e207 req-d9cd1068-dfcb-47e5-999e-9a152eade56b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:50.158140 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-a2cf9c59-a2ea-406f-92c8-829f9e22e207 req-d9cd1068-dfcb-47e5-999e-9a152eade56b service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:50.169525 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-a2cf9c59-a2ea-406f-92c8-829f9e22e207 req-d9cd1068-dfcb-47e5-999e-9a152eade56b service nova] Creating event network-changed:b478792f-ef04-4e67-9b7d-7f28eaf19a2d for instance a875e416-cd4f-4ef4-b5f3-f9e1174ff843 on hv-cinder-82414 Sep 15 07:46:50.174811 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-a2cf9c59-a2ea-406f-92c8-829f9e22e207 req-d9cd1068-dfcb-47e5-999e-9a152eade56b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031464 Sep 15 07:46:50.175352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 435/892] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:46:50.971464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9685b854-4eb1-46e9-b7a0-2fa4ae8494f5 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:50.972111 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9685b854-4eb1-46e9-b7a0-2fa4ae8494f5 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:50.978963 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9685b854-4eb1-46e9-b7a0-2fa4ae8494f5 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:50.979456 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9685b854-4eb1-46e9-b7a0-2fa4ae8494f5 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:50.979914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9685b854-4eb1-46e9-b7a0-2fa4ae8494f5 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:50.980591 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9685b854-4eb1-46e9-b7a0-2fa4ae8494f5 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:50.981638 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9685b854-4eb1-46e9-b7a0-2fa4ae8494f5 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:50.982119 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9685b854-4eb1-46e9-b7a0-2fa4ae8494f5 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:51.122880 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9685b854-4eb1-46e9-b7a0-2fa4ae8494f5 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:51.130466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9685b854-4eb1-46e9-b7a0-2fa4ae8494f5 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1314 microversion: 2.1 time: 0.162881 Sep 15 07:46:51.131027 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 458/893] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:50 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:52.155043 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-1cf198ed-f2b2-48c3-94f5-fbfb7f377617 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:52.155745 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-1cf198ed-f2b2-48c3-94f5-fbfb7f377617 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:52.162094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1cf198ed-f2b2-48c3-94f5-fbfb7f377617 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:52.163558 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1cf198ed-f2b2-48c3-94f5-fbfb7f377617 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:52.163558 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1cf198ed-f2b2-48c3-94f5-fbfb7f377617 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:52.163826 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1cf198ed-f2b2-48c3-94f5-fbfb7f377617 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:52.164093 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1cf198ed-f2b2-48c3-94f5-fbfb7f377617 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:52.164512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-1cf198ed-f2b2-48c3-94f5-fbfb7f377617 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:52.293488 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-1cf198ed-f2b2-48c3-94f5-fbfb7f377617 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:52.305884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-1cf198ed-f2b2-48c3-94f5-fbfb7f377617 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1314 microversion: 2.1 time: 0.155905 Sep 15 07:46:52.306475 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 436/894] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:52 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:53.340624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-869e672d-24ed-4a0e-bc5d-479a6db41c2b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:53.341234 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-869e672d-24ed-4a0e-bc5d-479a6db41c2b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:53.347388 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-869e672d-24ed-4a0e-bc5d-479a6db41c2b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:53.347870 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-869e672d-24ed-4a0e-bc5d-479a6db41c2b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:53.348305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-869e672d-24ed-4a0e-bc5d-479a6db41c2b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:53.349259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-869e672d-24ed-4a0e-bc5d-479a6db41c2b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:53.349743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-869e672d-24ed-4a0e-bc5d-479a6db41c2b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:53.350167 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-869e672d-24ed-4a0e-bc5d-479a6db41c2b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:53.482693 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-869e672d-24ed-4a0e-bc5d-479a6db41c2b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:53.490205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-869e672d-24ed-4a0e-bc5d-479a6db41c2b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1314 microversion: 2.1 time: 0.153432 Sep 15 07:46:53.490765 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 459/895] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:53 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:54.513074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-971a8add-e911-4971-9ea9-347e0333d51a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:54.513720 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-971a8add-e911-4971-9ea9-347e0333d51a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:54.519734 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-971a8add-e911-4971-9ea9-347e0333d51a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:54.520222 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-971a8add-e911-4971-9ea9-347e0333d51a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:54.520662 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-971a8add-e911-4971-9ea9-347e0333d51a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:54.521361 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-971a8add-e911-4971-9ea9-347e0333d51a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:54.521847 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-971a8add-e911-4971-9ea9-347e0333d51a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:54.522278 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-971a8add-e911-4971-9ea9-347e0333d51a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:54.654496 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-971a8add-e911-4971-9ea9-347e0333d51a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:54.662082 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-971a8add-e911-4971-9ea9-347e0333d51a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1314 microversion: 2.1 time: 0.153744 Sep 15 07:46:54.662684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 437/896] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:54 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:55.688495 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-cba80d94-fdd1-48ad-9d8a-1528bbfb0b5a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:55.691461 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-cba80d94-fdd1-48ad-9d8a-1528bbfb0b5a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:55.696996 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:55.700511 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cba80d94-fdd1-48ad-9d8a-1528bbfb0b5a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:55.701020 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cba80d94-fdd1-48ad-9d8a-1528bbfb0b5a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:55.702223 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cba80d94-fdd1-48ad-9d8a-1528bbfb0b5a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:55.702977 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cba80d94-fdd1-48ad-9d8a-1528bbfb0b5a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:55.704142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cba80d94-fdd1-48ad-9d8a-1528bbfb0b5a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:55.704642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cba80d94-fdd1-48ad-9d8a-1528bbfb0b5a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:55.844485 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-cba80d94-fdd1-48ad-9d8a-1528bbfb0b5a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:55.847167 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-cba80d94-fdd1-48ad-9d8a-1528bbfb0b5a tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1314 microversion: 2.1 time: 0.164845 Sep 15 07:46:55.847734 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 460/897] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:55 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:55.957465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-c774ff0d-b9d5-40dd-9b08-73ec144cdce7 req-ae300abd-b4e8-4729-b7e3-b1ee0773ca47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a875e416-cd4f-4ef4-b5f3-f9e1174ff843", "name": "network-vif-plugged", "status": "completed", "tag": "b478792f-ef04-4e67-9b7d-7f28eaf19a2d"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:46:55.971512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:55.971512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=6 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:46:55.973824 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c774ff0d-b9d5-40dd-9b08-73ec144cdce7 req-ae300abd-b4e8-4729-b7e3-b1ee0773ca47 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:55.974507 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c774ff0d-b9d5-40dd-9b08-73ec144cdce7 req-ae300abd-b4e8-4729-b7e3-b1ee0773ca47 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:55.975098 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c774ff0d-b9d5-40dd-9b08-73ec144cdce7 req-ae300abd-b4e8-4729-b7e3-b1ee0773ca47 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:55.989468 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-c774ff0d-b9d5-40dd-9b08-73ec144cdce7 req-ae300abd-b4e8-4729-b7e3-b1ee0773ca47 service nova] Creating event network-vif-plugged:b478792f-ef04-4e67-9b7d-7f28eaf19a2d for instance a875e416-cd4f-4ef4-b5f3-f9e1174ff843 on hv-cinder-82414 Sep 15 07:46:55.995552 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-c774ff0d-b9d5-40dd-9b08-73ec144cdce7 req-ae300abd-b4e8-4729-b7e3-b1ee0773ca47 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042619 Sep 15 07:46:55.996847 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 438/898] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:46:56.428187 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a641247e-e6ed-42dd-b31d-c1587fb231ad tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:56.428702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a641247e-e6ed-42dd-b31d-c1587fb231ad tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:56.438153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-50f21441-d5fa-44a5-8b9a-c84a0019381e req-84c3b380-0ab0-4a7a-8688-5d6a55cf5875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08d61aa0-bcb6-4fe0-bc26-20ef85c5025e", "tag": "a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:46:56.448544 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-50f21441-d5fa-44a5-8b9a-c84a0019381e req-84c3b380-0ab0-4a7a-8688-5d6a55cf5875 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:56.450872 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-50f21441-d5fa-44a5-8b9a-c84a0019381e req-84c3b380-0ab0-4a7a-8688-5d6a55cf5875 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:56.454117 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a641247e-e6ed-42dd-b31d-c1587fb231ad tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:56.454610 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a641247e-e6ed-42dd-b31d-c1587fb231ad tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:56.455146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a641247e-e6ed-42dd-b31d-c1587fb231ad tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:56.455892 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a641247e-e6ed-42dd-b31d-c1587fb231ad tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:56.456349 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a641247e-e6ed-42dd-b31d-c1587fb231ad tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:56.456777 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a641247e-e6ed-42dd-b31d-c1587fb231ad tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:56.461612 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-50f21441-d5fa-44a5-8b9a-c84a0019381e req-84c3b380-0ab0-4a7a-8688-5d6a55cf5875 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:56.473453 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-50f21441-d5fa-44a5-8b9a-c84a0019381e req-84c3b380-0ab0-4a7a-8688-5d6a55cf5875 service nova] Creating event network-changed:a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14 for instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e on hv-cinder-82414 Sep 15 07:46:56.479117 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-50f21441-d5fa-44a5-8b9a-c84a0019381e req-84c3b380-0ab0-4a7a-8688-5d6a55cf5875 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046252 Sep 15 07:46:56.479788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 439/899] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:46:56.485047 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a641247e-e6ed-42dd-b31d-c1587fb231ad tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:46:56.811488 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a641247e-e6ed-42dd-b31d-c1587fb231ad tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "DELETE /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 204 len: 0 microversion: 2.1 time: 0.387713 Sep 15 07:46:56.812180 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 461/900] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:46:56 2022] DELETE /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:46:56.820858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a7323eef-48e0-4816-8226-2378b92bc001 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:56.821550 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a7323eef-48e0-4816-8226-2378b92bc001 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:56.827897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7323eef-48e0-4816-8226-2378b92bc001 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:56.828377 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7323eef-48e0-4816-8226-2378b92bc001 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:56.828805 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7323eef-48e0-4816-8226-2378b92bc001 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:56.829489 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7323eef-48e0-4816-8226-2378b92bc001 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:56.829991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7323eef-48e0-4816-8226-2378b92bc001 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:56.830455 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a7323eef-48e0-4816-8226-2378b92bc001 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:56.873040 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9b25fae1-6b42-4966-8da5-79b39140737e tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:56.873829 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9b25fae1-6b42-4966-8da5-79b39140737e tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:56.879938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b25fae1-6b42-4966-8da5-79b39140737e tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:56.880418 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b25fae1-6b42-4966-8da5-79b39140737e tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:56.880855 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b25fae1-6b42-4966-8da5-79b39140737e tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:56.881556 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b25fae1-6b42-4966-8da5-79b39140737e tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:56.882176 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b25fae1-6b42-4966-8da5-79b39140737e tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:56.882611 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9b25fae1-6b42-4966-8da5-79b39140737e tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:57.026333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a7323eef-48e0-4816-8226-2378b92bc001 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:57.038340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a7323eef-48e0-4816-8226-2378b92bc001 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.221284 Sep 15 07:46:57.048928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 440/901] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:56 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:57.062635 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9b25fae1-6b42-4966-8da5-79b39140737e tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:57.071258 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9b25fae1-6b42-4966-8da5-79b39140737e tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1314 microversion: 2.1 time: 0.204653 Sep 15 07:46:57.072116 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 462/902] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:56 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:46:57.206522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5122b205-b4a0-49c4-9dfe-6bff86022a62 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:57.207251 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5122b205-b4a0-49c4-9dfe-6bff86022a62 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:57.213453 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5122b205-b4a0-49c4-9dfe-6bff86022a62 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:57.214005 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5122b205-b4a0-49c4-9dfe-6bff86022a62 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:57.215018 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5122b205-b4a0-49c4-9dfe-6bff86022a62 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:57.215736 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5122b205-b4a0-49c4-9dfe-6bff86022a62 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:57.216200 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5122b205-b4a0-49c4-9dfe-6bff86022a62 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:57.216638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5122b205-b4a0-49c4-9dfe-6bff86022a62 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:57.242475 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5122b205-b4a0-49c4-9dfe-6bff86022a62 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/ips" status: 200 len: 147 microversion: 2.1 time: 0.039789 Sep 15 07:46:57.243058 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 441/903] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 15 07:46:57 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:46:58.069364 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d171ab9d-e6a3-4be4-b1d3-eaf0c8ff9ea7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:58.070021 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d171ab9d-e6a3-4be4-b1d3-eaf0c8ff9ea7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:58.077251 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d171ab9d-e6a3-4be4-b1d3-eaf0c8ff9ea7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:58.077793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d171ab9d-e6a3-4be4-b1d3-eaf0c8ff9ea7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:58.078240 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d171ab9d-e6a3-4be4-b1d3-eaf0c8ff9ea7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:58.078933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d171ab9d-e6a3-4be4-b1d3-eaf0c8ff9ea7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:58.079390 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d171ab9d-e6a3-4be4-b1d3-eaf0c8ff9ea7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:58.079817 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d171ab9d-e6a3-4be4-b1d3-eaf0c8ff9ea7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:58.095050 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-928e25ee-0ec7-4c32-89ea-222fb24e6364 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:58.095657 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-928e25ee-0ec7-4c32-89ea-222fb24e6364 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:58.102438 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-928e25ee-0ec7-4c32-89ea-222fb24e6364 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:58.102923 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-928e25ee-0ec7-4c32-89ea-222fb24e6364 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:58.103357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-928e25ee-0ec7-4c32-89ea-222fb24e6364 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:58.104045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-928e25ee-0ec7-4c32-89ea-222fb24e6364 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:58.104489 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-928e25ee-0ec7-4c32-89ea-222fb24e6364 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:58.104908 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-928e25ee-0ec7-4c32-89ea-222fb24e6364 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:58.282735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d171ab9d-e6a3-4be4-b1d3-eaf0c8ff9ea7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:58.285756 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-928e25ee-0ec7-4c32-89ea-222fb24e6364 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:58.290635 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d171ab9d-e6a3-4be4-b1d3-eaf0c8ff9ea7 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.225111 Sep 15 07:46:58.291214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 463/904] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:58 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:58.293830 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-928e25ee-0ec7-4c32-89ea-222fb24e6364 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1314 microversion: 2.1 time: 0.202506 Sep 15 07:46:58.294407 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 442/905] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:58 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:46:59.314107 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b529d4bd-6736-4fc4-bcd3-2c743b711c33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:59.314748 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b529d4bd-6736-4fc4-bcd3-2c743b711c33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:59.319415 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-423039ce-6e54-458d-b1a1-b06ff1a80679 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:46:59.320019 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-423039ce-6e54-458d-b1a1-b06ff1a80679 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:46:59.321455 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b529d4bd-6736-4fc4-bcd3-2c743b711c33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:59.321976 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b529d4bd-6736-4fc4-bcd3-2c743b711c33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:59.322410 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b529d4bd-6736-4fc4-bcd3-2c743b711c33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:59.323137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b529d4bd-6736-4fc4-bcd3-2c743b711c33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:59.323578 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b529d4bd-6736-4fc4-bcd3-2c743b711c33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:59.324246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b529d4bd-6736-4fc4-bcd3-2c743b711c33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:59.326988 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-423039ce-6e54-458d-b1a1-b06ff1a80679 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:59.327472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-423039ce-6e54-458d-b1a1-b06ff1a80679 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:59.327906 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-423039ce-6e54-458d-b1a1-b06ff1a80679 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:59.328587 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-423039ce-6e54-458d-b1a1-b06ff1a80679 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:46:59.329064 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-423039ce-6e54-458d-b1a1-b06ff1a80679 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:46:59.329483 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-423039ce-6e54-458d-b1a1-b06ff1a80679 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:46:59.524193 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b529d4bd-6736-4fc4-bcd3-2c743b711c33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:59.528335 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-423039ce-6e54-458d-b1a1-b06ff1a80679 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:46:59.533044 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b529d4bd-6736-4fc4-bcd3-2c743b711c33 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.222860 Sep 15 07:46:59.533671 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 464/906] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:59 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:46:59.536373 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-423039ce-6e54-458d-b1a1-b06ff1a80679 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1314 microversion: 2.1 time: 0.220639 Sep 15 07:46:59.536930 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 443/907] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:46:59 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:00.557216 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2209721e-eec3-485f-8bb7-b2532b595c89 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:00.558038 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2209721e-eec3-485f-8bb7-b2532b595c89 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:00.560115 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c1878eb1-50b0-4b8a-bcf2-f3717ceaa1b4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:00.560723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c1878eb1-50b0-4b8a-bcf2-f3717ceaa1b4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:00.564765 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2209721e-eec3-485f-8bb7-b2532b595c89 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:00.565249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2209721e-eec3-485f-8bb7-b2532b595c89 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:00.565714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2209721e-eec3-485f-8bb7-b2532b595c89 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:00.566410 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2209721e-eec3-485f-8bb7-b2532b595c89 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:00.566981 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2209721e-eec3-485f-8bb7-b2532b595c89 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:00.567091 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1878eb1-50b0-4b8a-bcf2-f3717ceaa1b4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:00.567408 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2209721e-eec3-485f-8bb7-b2532b595c89 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:00.567519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1878eb1-50b0-4b8a-bcf2-f3717ceaa1b4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:00.567928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1878eb1-50b0-4b8a-bcf2-f3717ceaa1b4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:00.568616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1878eb1-50b0-4b8a-bcf2-f3717ceaa1b4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:00.569065 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1878eb1-50b0-4b8a-bcf2-f3717ceaa1b4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:00.569490 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1878eb1-50b0-4b8a-bcf2-f3717ceaa1b4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:00.754371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c1878eb1-50b0-4b8a-bcf2-f3717ceaa1b4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:00.762764 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c1878eb1-50b0-4b8a-bcf2-f3717ceaa1b4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1314 microversion: 2.1 time: 0.206470 Sep 15 07:47:00.763660 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 444/908] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:00 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:00.790026 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2209721e-eec3-485f-8bb7-b2532b595c89 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:00.798149 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2209721e-eec3-485f-8bb7-b2532b595c89 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1568 microversion: 2.1 time: 0.244998 Sep 15 07:47:00.798711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 465/909] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:00 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:01.787650 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c42ba19e-adfe-40e7-96bc-ac355d592343 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:01.788264 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c42ba19e-adfe-40e7-96bc-ac355d592343 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:01.795203 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c42ba19e-adfe-40e7-96bc-ac355d592343 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:01.795694 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c42ba19e-adfe-40e7-96bc-ac355d592343 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:01.796123 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c42ba19e-adfe-40e7-96bc-ac355d592343 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:01.796864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c42ba19e-adfe-40e7-96bc-ac355d592343 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:01.797533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c42ba19e-adfe-40e7-96bc-ac355d592343 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:01.797920 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c42ba19e-adfe-40e7-96bc-ac355d592343 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:01.806361 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-712388bb-5d84-4ad5-a165-b08634073297 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "000188c6-003e-48ee-baa8-88b8b03a6916"}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:01.809266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-712388bb-5d84-4ad5-a165-b08634073297 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:01.816742 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-712388bb-5d84-4ad5-a165-b08634073297 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:01.826987 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-712388bb-5d84-4ad5-a165-b08634073297 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:01.827452 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-712388bb-5d84-4ad5-a165-b08634073297 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:01.828201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-712388bb-5d84-4ad5-a165-b08634073297 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:01.828668 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-712388bb-5d84-4ad5-a165-b08634073297 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:01.829092 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-712388bb-5d84-4ad5-a165-b08634073297 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:01.985069 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c42ba19e-adfe-40e7-96bc-ac355d592343 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:01.994030 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c42ba19e-adfe-40e7-96bc-ac355d592343 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1498 microversion: 2.1 time: 0.209857 Sep 15 07:47:02.000853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 445/910] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:01 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1498 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:02.000853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-eddd752a-b8ec-4cf8-8e4a-87e5150d0741 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:02.000853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-eddd752a-b8ec-4cf8-8e4a-87e5150d0741 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:02.008044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eddd752a-b8ec-4cf8-8e4a-87e5150d0741 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:02.008813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eddd752a-b8ec-4cf8-8e4a-87e5150d0741 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:02.011546 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eddd752a-b8ec-4cf8-8e4a-87e5150d0741 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:02.012616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eddd752a-b8ec-4cf8-8e4a-87e5150d0741 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:02.013417 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eddd752a-b8ec-4cf8-8e4a-87e5150d0741 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:02.014649 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eddd752a-b8ec-4cf8-8e4a-87e5150d0741 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:02.098231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-eddd752a-b8ec-4cf8-8e4a-87e5150d0741 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:02.107597 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-eddd752a-b8ec-4cf8-8e4a-87e5150d0741 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1382 microversion: 2.1 time: 0.111459 Sep 15 07:47:02.108367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 446/911] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:01 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1382 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:02.120444 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-c27042c0-e99a-4d76-98d6-5c748f5509ae req-99e63544-ded9-42f3-b255-f3f8dbd5295e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08d61aa0-bcb6-4fe0-bc26-20ef85c5025e", "name": "network-vif-deleted", "tag": "a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:02.123241 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c27042c0-e99a-4d76-98d6-5c748f5509ae req-99e63544-ded9-42f3-b255-f3f8dbd5295e service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:02.123723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c27042c0-e99a-4d76-98d6-5c748f5509ae req-99e63544-ded9-42f3-b255-f3f8dbd5295e service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:02.124153 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c27042c0-e99a-4d76-98d6-5c748f5509ae req-99e63544-ded9-42f3-b255-f3f8dbd5295e service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:02.135368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-c27042c0-e99a-4d76-98d6-5c748f5509ae req-99e63544-ded9-42f3-b255-f3f8dbd5295e service nova] Creating event network-vif-deleted:a2038fe2-5f0d-43e2-96b0-b1c3e3a35f14 for instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e on hv-cinder-82414 Sep 15 07:47:02.141799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-c27042c0-e99a-4d76-98d6-5c748f5509ae req-99e63544-ded9-42f3-b255-f3f8dbd5295e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031495 Sep 15 07:47:02.142414 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 447/912] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:47:02.683614 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-712388bb-5d84-4ad5-a165-b08634073297 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "POST /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880785 Sep 15 07:47:02.684129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 466/913] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:47:01 2022] POST /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/os-volume_attachments => generated 194 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:47:03.137829 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ff89a7f4-7921-4ef8-ad96-b4892156649e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:03.138537 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ff89a7f4-7921-4ef8-ad96-b4892156649e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:03.145035 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff89a7f4-7921-4ef8-ad96-b4892156649e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:03.145507 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff89a7f4-7921-4ef8-ad96-b4892156649e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:03.145970 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff89a7f4-7921-4ef8-ad96-b4892156649e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:03.146646 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff89a7f4-7921-4ef8-ad96-b4892156649e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:03.147095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff89a7f4-7921-4ef8-ad96-b4892156649e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:03.147511 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ff89a7f4-7921-4ef8-ad96-b4892156649e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:03.215752 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ff89a7f4-7921-4ef8-ad96-b4892156649e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:03.223548 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ff89a7f4-7921-4ef8-ad96-b4892156649e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1219 microversion: 2.1 time: 0.090634 Sep 15 07:47:03.224104 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 448/914] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:03 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:04.248957 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-31001e5b-9da0-48c0-9d6b-0f6969058679 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:04.248957 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-31001e5b-9da0-48c0-9d6b-0f6969058679 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:04.254689 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31001e5b-9da0-48c0-9d6b-0f6969058679 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:04.255176 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31001e5b-9da0-48c0-9d6b-0f6969058679 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:04.255639 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31001e5b-9da0-48c0-9d6b-0f6969058679 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:04.256373 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31001e5b-9da0-48c0-9d6b-0f6969058679 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:04.256824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31001e5b-9da0-48c0-9d6b-0f6969058679 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:04.257248 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31001e5b-9da0-48c0-9d6b-0f6969058679 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:04.359574 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-31001e5b-9da0-48c0-9d6b-0f6969058679 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:04.359574 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-31001e5b-9da0-48c0-9d6b-0f6969058679 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1219 microversion: 2.1 time: 0.087371 Sep 15 07:47:04.359574 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 467/915] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:04 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:05.381269 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a0551d5b-93f2-422e-ad8f-914253a601b5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:05.381923 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a0551d5b-93f2-422e-ad8f-914253a601b5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:05.389439 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a0551d5b-93f2-422e-ad8f-914253a601b5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:05.394313 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a0551d5b-93f2-422e-ad8f-914253a601b5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:05.394313 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a0551d5b-93f2-422e-ad8f-914253a601b5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:05.394313 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a0551d5b-93f2-422e-ad8f-914253a601b5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:05.394313 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a0551d5b-93f2-422e-ad8f-914253a601b5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:05.394696 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a0551d5b-93f2-422e-ad8f-914253a601b5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:05.458257 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a0551d5b-93f2-422e-ad8f-914253a601b5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:05.466354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a0551d5b-93f2-422e-ad8f-914253a601b5 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1219 microversion: 2.1 time: 0.088955 Sep 15 07:47:05.466921 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 449/916] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:05 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:05.665952 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-52247825-9840-40f9-88ab-df9aaf1b3508 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:05.666612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-52247825-9840-40f9-88ab-df9aaf1b3508 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:05.673406 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-52247825-9840-40f9-88ab-df9aaf1b3508 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:05.673927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-52247825-9840-40f9-88ab-df9aaf1b3508 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:05.674359 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-52247825-9840-40f9-88ab-df9aaf1b3508 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:05.675070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-52247825-9840-40f9-88ab-df9aaf1b3508 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:05.675493 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-52247825-9840-40f9-88ab-df9aaf1b3508 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:05.675916 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-52247825-9840-40f9-88ab-df9aaf1b3508 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:05.703775 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-52247825-9840-40f9-88ab-df9aaf1b3508 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:47:05.733764 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:06.011333 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-52247825-9840-40f9-88ab-df9aaf1b3508 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 204 len: 0 microversion: 2.1 time: 0.348266 Sep 15 07:47:06.011948 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 468/917] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:47:05 2022] DELETE /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:47:06.020062 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-fd74386c-2f78-4b57-8d32-b5146f99d362 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:06.020655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-fd74386c-2f78-4b57-8d32-b5146f99d362 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:06.027292 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd74386c-2f78-4b57-8d32-b5146f99d362 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:06.027761 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd74386c-2f78-4b57-8d32-b5146f99d362 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:06.028187 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd74386c-2f78-4b57-8d32-b5146f99d362 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:06.028894 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd74386c-2f78-4b57-8d32-b5146f99d362 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:06.029340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd74386c-2f78-4b57-8d32-b5146f99d362 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:06.029788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-fd74386c-2f78-4b57-8d32-b5146f99d362 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:06.166359 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-fd74386c-2f78-4b57-8d32-b5146f99d362 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:06.174760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-fd74386c-2f78-4b57-8d32-b5146f99d362 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1504 microversion: 2.1 time: 0.158570 Sep 15 07:47:06.178115 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 450/918] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:06 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:06.489233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:06.490125 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:06.496156 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:06.496632 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:06.497062 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:06.497778 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:06.498227 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:06.498643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:06.530607 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:06.531087 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:06.531522 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:06.531961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lazy-loading 'fault' on Instance uuid 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:47:06.571545 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:06.580026 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5fbd3b01-1a36-406f-a880-d00374604d36 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1224 microversion: 2.1 time: 0.095234 Sep 15 07:47:06.580586 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 469/919] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:06 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:07.199489 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e96ce9c7-e48d-4c7c-9312-be3e340ae38f tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:07.200135 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e96ce9c7-e48d-4c7c-9312-be3e340ae38f tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:07.206780 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e96ce9c7-e48d-4c7c-9312-be3e340ae38f tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:07.207280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e96ce9c7-e48d-4c7c-9312-be3e340ae38f tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:07.207687 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e96ce9c7-e48d-4c7c-9312-be3e340ae38f tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:07.208387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e96ce9c7-e48d-4c7c-9312-be3e340ae38f tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:07.208843 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e96ce9c7-e48d-4c7c-9312-be3e340ae38f tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:07.209267 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e96ce9c7-e48d-4c7c-9312-be3e340ae38f tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:07.346987 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e96ce9c7-e48d-4c7c-9312-be3e340ae38f tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:07.356598 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e96ce9c7-e48d-4c7c-9312-be3e340ae38f tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1504 microversion: 2.1 time: 0.161566 Sep 15 07:47:07.357171 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 451/920] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:07 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:07.604457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:07.604987 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:07.611492 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:07.611974 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:07.612688 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:07.613381 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:07.613887 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:07.614309 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:07.654252 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:07.654739 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:07.655181 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:07.655628 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lazy-loading 'fault' on Instance uuid 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:47:07.705242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:07.713214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f1590882-dda8-4c87-87b4-47c9e79d1e9d tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1224 microversion: 2.1 time: 0.112781 Sep 15 07:47:07.713807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 470/921] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:07 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:08.380897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-45203a04-6376-4e60-9229-2300b6fe93f7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:08.386274 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-45203a04-6376-4e60-9229-2300b6fe93f7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:08.388405 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45203a04-6376-4e60-9229-2300b6fe93f7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:08.388889 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45203a04-6376-4e60-9229-2300b6fe93f7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:08.389327 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45203a04-6376-4e60-9229-2300b6fe93f7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:08.390045 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45203a04-6376-4e60-9229-2300b6fe93f7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:08.390540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45203a04-6376-4e60-9229-2300b6fe93f7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:08.390958 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-45203a04-6376-4e60-9229-2300b6fe93f7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:08.395185 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=100 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:08.518368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-45203a04-6376-4e60-9229-2300b6fe93f7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:08.526005 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-45203a04-6376-4e60-9229-2300b6fe93f7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1504 microversion: 2.1 time: 0.149037 Sep 15 07:47:08.527117 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 452/922] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:08 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:08.736626 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:08.737194 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:08.743683 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:08.744166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:08.744632 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:08.745432 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:08.746627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:08.746627 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:08.781154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:08.781661 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:08.782097 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:08.782543 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lazy-loading 'fault' on Instance uuid 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:47:08.826987 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:08.834653 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ce8af2b4-1809-4d76-968b-d4944561366f tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1224 microversion: 2.1 time: 0.102029 Sep 15 07:47:08.835220 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 471/923] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:08 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:09.549457 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-464ab392-9520-49c2-b4a8-9f57d999c7e0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:09.550108 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-464ab392-9520-49c2-b4a8-9f57d999c7e0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:09.556758 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-464ab392-9520-49c2-b4a8-9f57d999c7e0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:09.557276 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-464ab392-9520-49c2-b4a8-9f57d999c7e0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:09.560485 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-464ab392-9520-49c2-b4a8-9f57d999c7e0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:09.560485 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-464ab392-9520-49c2-b4a8-9f57d999c7e0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:09.560485 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-464ab392-9520-49c2-b4a8-9f57d999c7e0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:09.560485 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-464ab392-9520-49c2-b4a8-9f57d999c7e0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:09.686759 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-464ab392-9520-49c2-b4a8-9f57d999c7e0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:09.694667 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-464ab392-9520-49c2-b4a8-9f57d999c7e0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1504 microversion: 2.1 time: 0.149166 Sep 15 07:47:09.695234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 453/924] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:09 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:09.858028 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:09.858643 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:09.865030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:09.865511 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:09.865984 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:09.866676 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:09.867128 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:09.867550 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:09.901738 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:09.902234 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:09.902677 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:09.903128 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lazy-loading 'fault' on Instance uuid 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:47:09.942910 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:09.950935 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-89a6f4ce-0a7e-43c9-abde-b7b781150265 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1224 microversion: 2.1 time: 0.096689 Sep 15 07:47:09.951510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 472/925] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:09 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:10.719022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-22940878-6217-4eea-a12c-11a5d0ebc0a0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:10.719659 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-22940878-6217-4eea-a12c-11a5d0ebc0a0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:10.727173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22940878-6217-4eea-a12c-11a5d0ebc0a0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:10.727831 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22940878-6217-4eea-a12c-11a5d0ebc0a0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:10.728326 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22940878-6217-4eea-a12c-11a5d0ebc0a0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:10.729779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22940878-6217-4eea-a12c-11a5d0ebc0a0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:10.730330 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22940878-6217-4eea-a12c-11a5d0ebc0a0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:10.730760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-22940878-6217-4eea-a12c-11a5d0ebc0a0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:10.865556 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-22940878-6217-4eea-a12c-11a5d0ebc0a0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:10.873698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-22940878-6217-4eea-a12c-11a5d0ebc0a0 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1504 microversion: 2.1 time: 0.158442 Sep 15 07:47:10.874268 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 454/926] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:10 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:10.974509 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:10.975054 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:10.982268 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:10.982750 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:10.983192 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:10.983868 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:10.984321 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:10.984743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:11.017424 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:11.018039 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:11.018410 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:11.018853 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lazy-loading 'fault' on Instance uuid 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:47:11.059806 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:11.067341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7e6f00d2-bfe1-41eb-a011-b5c62b2ef0d4 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1224 microversion: 2.1 time: 0.097019 Sep 15 07:47:11.067893 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 473/927] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:10 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:11.897263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ae2e7e66-54fd-496d-96da-98dee6417157 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:11.897897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ae2e7e66-54fd-496d-96da-98dee6417157 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:11.905059 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae2e7e66-54fd-496d-96da-98dee6417157 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:11.905542 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae2e7e66-54fd-496d-96da-98dee6417157 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:11.906005 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae2e7e66-54fd-496d-96da-98dee6417157 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:11.906699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae2e7e66-54fd-496d-96da-98dee6417157 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:11.907168 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae2e7e66-54fd-496d-96da-98dee6417157 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:11.907588 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae2e7e66-54fd-496d-96da-98dee6417157 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:12.091210 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:12.092428 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:12.098678 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:12.099174 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:12.099616 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:12.100536 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:12.100992 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:12.101424 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:12.134864 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:12.134864 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:12.135768 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:12.137315 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lazy-loading 'fault' on Instance uuid 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:47:12.138319 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ae2e7e66-54fd-496d-96da-98dee6417157 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:12.162246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ae2e7e66-54fd-496d-96da-98dee6417157 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1504 microversion: 2.1 time: 0.268690 Sep 15 07:47:12.162962 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 455/928] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:11 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:12.220748 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1410abac494fd18c859268b528ec0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e20a6e5fded473c8905bffff7775ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:12.228746 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-40fab288-3d6d-42bc-9983-befd946089d0 tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 200 len: 1224 microversion: 2.1 time: 0.142227 Sep 15 07:47:12.230339 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 474/929] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:12 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 1224 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:12.575227 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-bd0c4c97-c644-45e6-8cae-81f8505c4d73 req-e8a5f60a-9790-467c-b608-da34fe846a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a875e416-cd4f-4ef4-b5f3-f9e1174ff843", "name": "network-vif-deleted", "tag": "b478792f-ef04-4e67-9b7d-7f28eaf19a2d"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:12.584398 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-bd0c4c97-c644-45e6-8cae-81f8505c4d73 req-e8a5f60a-9790-467c-b608-da34fe846a62 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:12.584879 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-bd0c4c97-c644-45e6-8cae-81f8505c4d73 req-e8a5f60a-9790-467c-b608-da34fe846a62 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:12.585310 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-bd0c4c97-c644-45e6-8cae-81f8505c4d73 req-e8a5f60a-9790-467c-b608-da34fe846a62 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:12.597507 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-bd0c4c97-c644-45e6-8cae-81f8505c4d73 req-e8a5f60a-9790-467c-b608-da34fe846a62 service nova] Creating event network-vif-deleted:b478792f-ef04-4e67-9b7d-7f28eaf19a2d for instance a875e416-cd4f-4ef4-b5f3-f9e1174ff843 on hv-cinder-82414 Sep 15 07:47:12.602532 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-bd0c4c97-c644-45e6-8cae-81f8505c4d73 req-e8a5f60a-9790-467c-b608-da34fe846a62 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031922 Sep 15 07:47:12.603120 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 456/930] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:47:13.187257 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:13.187935 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:13.194279 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:13.194756 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:13.195189 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:13.195878 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:13.196329 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:13.196744 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:13.232781 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:13.233269 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:13.233742 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:13.234621 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lazy-loading 'fault' on Instance uuid a875e416-cd4f-4ef4-b5f3-f9e1174ff843 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:47:13.255731 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:13.256815 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] [instance: 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:13.266540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:13.268545 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:13.269236 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:13.270292 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:13.270974 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:13.271637 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:13.288522 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:13.288804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] HTTP exception thrown: Instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e could not be found. Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Request method failure captured: Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e HTTP/1.1 Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItcwFgLYEPYrr1E13WaWMkObP9VtUxxyagk45j6Be0KTYRRfCOXck3Wz90VZDXNFEPLDcS6oQWMHuHq5OaXDyHBzmd7IGSJoQzl482M4jPuMUstT5-6QFUZjrfdMv-BgkZVl4_XaHjou49MF5xZsLvu3GHQ2X9WLn3pshgSTNY-rUic Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 7e20a6e5fded473c8905bffff7775ed3 Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-TestShelveInstance-1434149981 Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:47:13.290677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7e20a6e5fded473c8905bffff7775ed3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e20a6e5fded473c8905bffff7775ed3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7e20a6e5fded473c8905bffff7775ed3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7e20a6e5fded473c8905bffff7775ed3"}]}] Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-TestShelveInstance-1434149981 Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 7e20a6e5fded473c8905bffff7775ed3 Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-TestShelveInstance-1434149981 Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-TestShelveInstance-1434149981-project Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 0a1410abac494fd18c859268b528ec0c Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-TestShelveInstance-1434149981-project Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e could not be found. Sep 15 07:47:13.292255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '08d61aa0-bcb6-4fe0-bc26-20ef85c5025e'} Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e could not be found. Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:47:13.293240 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e could not be found. Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e could not be found. Sep 15 07:47:13.294823 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:47:13.296178 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Returning 404 to user: Instance 08d61aa0-bcb6-4fe0-bc26-20ef85c5025e could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:47:13.296178 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-79301025-ec5a-4d15-b79d-26dcaf5f15ff tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e" status: 404 len: 111 microversion: 2.1 time: 0.044831 Sep 15 07:47:13.296178 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 457/931] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:13 2022] GET /compute/v2.1/servers/08d61aa0-bcb6-4fe0-bc26-20ef85c5025e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:47:13.300011 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ac48685b-3c6d-44fd-b8df-7953b56b0166 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 200 len: 1304 microversion: 2.1 time: 0.116433 Sep 15 07:47:13.300666 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 475/932] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:13 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:13.521545 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-07d24031-a3e2-4965-88e6-ab3efd29d96e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] Calling method '.version_select at 0x7ff36c7d7b80>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:13.599708 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-07d24031-a3e2-4965-88e6-ab3efd29d96e tempest-TestShelveInstance-1434149981 tempest-TestShelveInstance-1434149981-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1265932845" status: 202 len: 0 microversion: 2.1 time: 0.081960 Sep 15 07:47:13.600289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 458/933] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Sep 15 07:47:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1265932845 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:47:14.324356 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:14.330601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: a875e416-cd4f-4ef4-b5f3-f9e1174ff843] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:14.331115 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:14.331604 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:14.332037 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:14.332722 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:14.333169 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:14.333604 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:14.347714 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] HTTP exception thrown: Instance a875e416-cd4f-4ef4-b5f3-f9e1174ff843 could not be found. Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Request method failure captured: Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 HTTP/1.1 Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjIthi59iNVrc7PSqDn0xVi7EskaUsimim4bxIu6ltcdJuCRlbf7MsIPQEAtVE5cHSdKSd91CPQIEv-SVd1WVc4tynGEwyfwsWOzf-kdyLu-RBCoa5lo1FLdAwQBlCuRgzWyK5RRWvajbFsL9re0ZWEa78IR6uE9Y8a84saDvCaAo3WJ8 Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: 988cf6a6fa2b452e8c4c017f282d144c Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-VolumesActionsTest-601705062 Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:47:14.349379 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_988cf6a6fa2b452e8c4c017f282d144c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/988cf6a6fa2b452e8c4c017f282d144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/988cf6a6fa2b452e8c4c017f282d144c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/988cf6a6fa2b452e8c4c017f282d144c"}]}] Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-VolumesActionsTest-601705062 Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: 988cf6a6fa2b452e8c4c017f282d144c Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-VolumesActionsTest-601705062 Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-VolumesActionsTest-601705062-project Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: 4d66f4fd90e74287ae9891e0364ab2cd Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-VolumesActionsTest-601705062-project Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance a875e416-cd4f-4ef4-b5f3-f9e1174ff843 could not be found. Sep 15 07:47:14.351086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': 'a875e416-cd4f-4ef4-b5f3-f9e1174ff843'} Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a875e416-cd4f-4ef4-b5f3-f9e1174ff843 could not be found. Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:47:14.352146 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a875e416-cd4f-4ef4-b5f3-f9e1174ff843 could not be found. Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a875e416-cd4f-4ef4-b5f3-f9e1174ff843 could not be found. Sep 15 07:47:14.354151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:47:14.355442 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Returning 404 to user: Instance a875e416-cd4f-4ef4-b5f3-f9e1174ff843 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:47:14.355442 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-178bfe82-1cce-4ae7-b010-848215831531 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843" status: 404 len: 111 microversion: 2.1 time: 0.030660 Sep 15 07:47:14.355442 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 476/934] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:14 2022] GET /compute/v2.1/servers/a875e416-cd4f-4ef4-b5f3-f9e1174ff843 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:47:14.466091 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-773843994", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "networks": [{"uuid": "6566ac70-70ae-4e19-b0b8-45ffeb54dc33"}]}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:14.519796 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] validate_networks() for [('6566ac70-70ae-4e19-b0b8-45ffeb54dc33', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:47:14.901547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:47:14.905213 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:47:14.905213 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:47:14.905213 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:47:14.905213 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:47:14.905555 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:14.914086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:14.914577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:14.915012 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:14.915779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:14.916820 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:14.917454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:14.938243 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Getting quotas for project 988cf6a6fa2b452e8c4c017f282d144c. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:47:14.943260 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Getting quotas for user 4d66f4fd90e74287ae9891e0364ab2cd and project 988cf6a6fa2b452e8c4c017f282d144c. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:47:14.956599 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:47:14.958972 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:47:15.114508 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-af087237-30c5-4fb5-975e-8072f0c62930 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653762 Sep 15 07:47:15.115462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 459/935] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:47:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 07:47:15.131218 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-51eb88e2-5b23-4a89-ab78-87f21e498a81 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:15.131421 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-51eb88e2-5b23-4a89-ab78-87f21e498a81 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:15.208620 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-51eb88e2-5b23-4a89-ab78-87f21e498a81 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:15.232496 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-51eb88e2-5b23-4a89-ab78-87f21e498a81 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1213 microversion: 2.1 time: 0.104201 Sep 15 07:47:15.241629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 477/936] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:15 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:15.305246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b8126303-cd0a-4e73-997f-f5b9397eb67f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:15.314404 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b8126303-cd0a-4e73-997f-f5b9397eb67f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:15.315035 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b8126303-cd0a-4e73-997f-f5b9397eb67f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:15.315571 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b8126303-cd0a-4e73-997f-f5b9397eb67f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:15.401688 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b8126303-cd0a-4e73-997f-f5b9397eb67f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Going to try to stop instance {{(pid=132673) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 07:47:15.674832 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b8126303-cd0a-4e73-997f-f5b9397eb67f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "POST /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/action" status: 202 len: 0 microversion: 2.1 time: 0.374591 Sep 15 07:47:15.675805 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 460/937] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:47:15 2022] POST /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:47:15.691026 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-91c873a2-692d-40bc-8466-1edaac905e71 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:15.693351 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-91c873a2-692d-40bc-8466-1edaac905e71 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:15.707665 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-91c873a2-692d-40bc-8466-1edaac905e71 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:15.708151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-91c873a2-692d-40bc-8466-1edaac905e71 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:15.713253 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-91c873a2-692d-40bc-8466-1edaac905e71 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:15.714045 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-91c873a2-692d-40bc-8466-1edaac905e71 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:15.714546 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-91c873a2-692d-40bc-8466-1edaac905e71 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:15.718061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-91c873a2-692d-40bc-8466-1edaac905e71 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:15.862499 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-91c873a2-692d-40bc-8466-1edaac905e71 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:15.872470 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-91c873a2-692d-40bc-8466-1edaac905e71 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.188575 Sep 15 07:47:15.873602 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 478/938] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:15 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:16.257753 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0eafe692-c3a9-4a87-9096-6daf7a21079c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:16.258648 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0eafe692-c3a9-4a87-9096-6daf7a21079c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:16.265342 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0eafe692-c3a9-4a87-9096-6daf7a21079c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:16.265869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0eafe692-c3a9-4a87-9096-6daf7a21079c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:16.266312 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0eafe692-c3a9-4a87-9096-6daf7a21079c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:16.267006 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0eafe692-c3a9-4a87-9096-6daf7a21079c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:16.267465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0eafe692-c3a9-4a87-9096-6daf7a21079c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:16.267891 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0eafe692-c3a9-4a87-9096-6daf7a21079c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:16.332885 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0eafe692-c3a9-4a87-9096-6daf7a21079c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:16.342539 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0eafe692-c3a9-4a87-9096-6daf7a21079c tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1217 microversion: 2.1 time: 0.089007 Sep 15 07:47:16.343315 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 461/939] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:16 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:16.499214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-384529710", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2002691772", "security_groups": [{"name": "tempest-secgroup-smoke-1463350431"}], "block_device_mapping_v2": [{"uuid": "e1053761-9bcd-4bcc-9f55-e3c74148c341", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2c10a638-2533-4c87-88f1-ce4db4dec0fd"}]}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:16.630042 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.network.neutron [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] validate_networks() for [('2c10a638-2533-4c87-88f1-ce4db4dec0fd', None, None, None, None, None)] {{(pid=132674) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:47:16.897470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-405c94ab-6049-498e-b674-bf0bb9fde157 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:16.898209 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-405c94ab-6049-498e-b674-bf0bb9fde157 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:16.906545 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-405c94ab-6049-498e-b674-bf0bb9fde157 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:16.907324 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-405c94ab-6049-498e-b674-bf0bb9fde157 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:16.907844 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-405c94ab-6049-498e-b674-bf0bb9fde157 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:16.909251 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-405c94ab-6049-498e-b674-bf0bb9fde157 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:16.909251 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-405c94ab-6049-498e-b674-bf0bb9fde157 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:16.909655 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-405c94ab-6049-498e-b674-bf0bb9fde157 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:17.414709 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-405c94ab-6049-498e-b674-bf0bb9fde157 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:17.430614 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-405c94ab-6049-498e-b674-bf0bb9fde157 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.534629 Sep 15 07:47:17.431996 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 462/940] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:16 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:17.463886 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-da4a4bd3-9c45-494d-b78a-4feff3ef7994 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:17.464684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-da4a4bd3-9c45-494d-b78a-4feff3ef7994 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:17.475278 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da4a4bd3-9c45-494d-b78a-4feff3ef7994 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:17.479897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da4a4bd3-9c45-494d-b78a-4feff3ef7994 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:17.481613 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da4a4bd3-9c45-494d-b78a-4feff3ef7994 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:17.484279 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Flavor limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:47:17.489386 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Image limits 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:47:17.489386 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Flavor pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:47:17.489386 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Image pref 0:0:0 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:47:17.489386 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.virt.hardware [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:47:17.490431 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da4a4bd3-9c45-494d-b78a-4feff3ef7994 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:17.491949 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da4a4bd3-9c45-494d-b78a-4feff3ef7994 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:17.492375 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-da4a4bd3-9c45-494d-b78a-4feff3ef7994 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:17.503570 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:17.504412 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:17.505896 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:17.506811 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:17.509426 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:17.510131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:17.558484 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Getting quotas for project af1e008c4bfa41e18488c63ea0f17b27. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:47:17.566115 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:17.567918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Getting quotas for user ebd85e42855448268c89a200f4392316 and project af1e008c4bfa41e18488c63ea0f17b27. Resources: {'instances', 'ram', 'cores'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:47:17.640716 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Going to run 1 instances... {{(pid=132674) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:47:17.643780 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1053761-9bcd-4bcc-9f55-e3c74148c341',volume_size=None,volume_type=None)] {{(pid=132674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:47:17.710131 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-da4a4bd3-9c45-494d-b78a-4feff3ef7994 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:17.719771 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-da4a4bd3-9c45-494d-b78a-4feff3ef7994 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1273 microversion: 2.1 time: 0.279989 Sep 15 07:47:17.721787 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 463/941] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:17 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:18.087223 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7405d278-bfac-4ab8-bf82-d12f77b237be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.591998 Sep 15 07:47:18.088743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 479/942] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:47:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:47:18.100565 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d8318b87-b0cd-4acf-b79e-51b5dbd399be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:18.101907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d8318b87-b0cd-4acf-b79e-51b5dbd399be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:18.220065 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d8318b87-b0cd-4acf-b79e-51b5dbd399be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:18.230314 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d8318b87-b0cd-4acf-b79e-51b5dbd399be tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1094 microversion: 2.1 time: 0.134586 Sep 15 07:47:18.246646 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 464/943] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:18 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:18.456804 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-5fd45dcd-b411-4c70-90bb-8297d26d8dbd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:18.457551 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-5fd45dcd-b411-4c70-90bb-8297d26d8dbd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:18.464807 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd45dcd-b411-4c70-90bb-8297d26d8dbd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:18.465373 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd45dcd-b411-4c70-90bb-8297d26d8dbd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:18.465917 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd45dcd-b411-4c70-90bb-8297d26d8dbd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:18.466703 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd45dcd-b411-4c70-90bb-8297d26d8dbd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:18.467327 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd45dcd-b411-4c70-90bb-8297d26d8dbd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:18.467934 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-5fd45dcd-b411-4c70-90bb-8297d26d8dbd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:18.711166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-5fd45dcd-b411-4c70-90bb-8297d26d8dbd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:18.721852 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-5fd45dcd-b411-4c70-90bb-8297d26d8dbd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.269005 Sep 15 07:47:18.722921 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 480/944] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:18 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:18.747836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ade272d7-b4cf-41f0-8e85-fe7fd7fb22af tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:18.748707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ade272d7-b4cf-41f0-8e85-fe7fd7fb22af tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:18.756841 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ade272d7-b4cf-41f0-8e85-fe7fd7fb22af tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:18.757560 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ade272d7-b4cf-41f0-8e85-fe7fd7fb22af tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:18.758021 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ade272d7-b4cf-41f0-8e85-fe7fd7fb22af tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:18.758730 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ade272d7-b4cf-41f0-8e85-fe7fd7fb22af tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:18.759917 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ade272d7-b4cf-41f0-8e85-fe7fd7fb22af tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:18.761201 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ade272d7-b4cf-41f0-8e85-fe7fd7fb22af tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:19.005026 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-ade272d7-b4cf-41f0-8e85-fe7fd7fb22af tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:19.029405 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ade272d7-b4cf-41f0-8e85-fe7fd7fb22af tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1313 microversion: 2.1 time: 0.287490 Sep 15 07:47:19.033038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 465/945] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:18 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:19.253673 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-2c246189-c82b-4994-bad6-6d0a4a2a926a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:19.254296 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-2c246189-c82b-4994-bad6-6d0a4a2a926a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:19.261374 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c246189-c82b-4994-bad6-6d0a4a2a926a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:19.266122 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c246189-c82b-4994-bad6-6d0a4a2a926a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:19.266593 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c246189-c82b-4994-bad6-6d0a4a2a926a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:19.267334 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c246189-c82b-4994-bad6-6d0a4a2a926a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:19.267815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c246189-c82b-4994-bad6-6d0a4a2a926a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:19.268239 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-2c246189-c82b-4994-bad6-6d0a4a2a926a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:19.368951 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-2c246189-c82b-4994-bad6-6d0a4a2a926a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:19.378368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-2c246189-c82b-4994-bad6-6d0a4a2a926a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1144 microversion: 2.1 time: 0.127660 Sep 15 07:47:19.379085 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 481/946] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:19 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1144 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:19.749071 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d9af44c5-ebe5-46eb-9829-258ff52b3e48 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:19.749734 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d9af44c5-ebe5-46eb-9829-258ff52b3e48 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:19.762593 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d9af44c5-ebe5-46eb-9829-258ff52b3e48 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:19.763085 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d9af44c5-ebe5-46eb-9829-258ff52b3e48 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:19.764344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d9af44c5-ebe5-46eb-9829-258ff52b3e48 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:19.765103 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d9af44c5-ebe5-46eb-9829-258ff52b3e48 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:19.765564 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d9af44c5-ebe5-46eb-9829-258ff52b3e48 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:19.766025 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d9af44c5-ebe5-46eb-9829-258ff52b3e48 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:19.886513 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-2e58fdd7-3cda-4776-aed0-ca979f40d97c req-c36af20a-e30c-4c1d-9d85-2b02cb3eb237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec05c81-a578-4380-b05f-7e4eab9f2103", "tag": "1b7de612-7337-4798-8d30-8d58396efb98"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:19.906498 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-2e58fdd7-3cda-4776-aed0-ca979f40d97c req-c36af20a-e30c-4c1d-9d85-2b02cb3eb237 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:19.907224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-2e58fdd7-3cda-4776-aed0-ca979f40d97c req-c36af20a-e30c-4c1d-9d85-2b02cb3eb237 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:19.909375 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-2e58fdd7-3cda-4776-aed0-ca979f40d97c req-c36af20a-e30c-4c1d-9d85-2b02cb3eb237 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:19.934348 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-2e58fdd7-3cda-4776-aed0-ca979f40d97c req-c36af20a-e30c-4c1d-9d85-2b02cb3eb237 service nova] Creating event network-changed:1b7de612-7337-4798-8d30-8d58396efb98 for instance eec05c81-a578-4380-b05f-7e4eab9f2103 on hv-cinder-82414 Sep 15 07:47:19.959130 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-2e58fdd7-3cda-4776-aed0-ca979f40d97c req-c36af20a-e30c-4c1d-9d85-2b02cb3eb237 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076993 Sep 15 07:47:19.964239 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 482/947] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:47:20.059312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ba6b0235-e8c6-4306-ad51-b5417f6eabec tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:20.060101 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ba6b0235-e8c6-4306-ad51-b5417f6eabec tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:20.065632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-d9af44c5-ebe5-46eb-9829-258ff52b3e48 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:20.067310 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba6b0235-e8c6-4306-ad51-b5417f6eabec tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:20.068191 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba6b0235-e8c6-4306-ad51-b5417f6eabec tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:20.068794 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba6b0235-e8c6-4306-ad51-b5417f6eabec tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:20.071266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba6b0235-e8c6-4306-ad51-b5417f6eabec tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:20.072505 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba6b0235-e8c6-4306-ad51-b5417f6eabec tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:20.073735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ba6b0235-e8c6-4306-ad51-b5417f6eabec tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:20.075740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d9af44c5-ebe5-46eb-9829-258ff52b3e48 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.332712 Sep 15 07:47:20.079642 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 466/948] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:19 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:20.345652 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ba6b0235-e8c6-4306-ad51-b5417f6eabec tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:20.360386 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ba6b0235-e8c6-4306-ad51-b5417f6eabec tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1313 microversion: 2.1 time: 0.306583 Sep 15 07:47:20.361797 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 483/949] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:20 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:20.401870 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-617d00a1-b48c-4533-bb92-a93d929c5981 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:20.402548 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-617d00a1-b48c-4533-bb92-a93d929c5981 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:20.409139 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-617d00a1-b48c-4533-bb92-a93d929c5981 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:20.409658 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-617d00a1-b48c-4533-bb92-a93d929c5981 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:20.410098 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-617d00a1-b48c-4533-bb92-a93d929c5981 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:20.410805 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-617d00a1-b48c-4533-bb92-a93d929c5981 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:20.411263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-617d00a1-b48c-4533-bb92-a93d929c5981 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:20.411692 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-617d00a1-b48c-4533-bb92-a93d929c5981 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:20.582380 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-617d00a1-b48c-4533-bb92-a93d929c5981 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:20.601404 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-617d00a1-b48c-4533-bb92-a93d929c5981 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1192 microversion: 2.1 time: 0.203253 Sep 15 07:47:20.602030 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 467/950] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:20 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1192 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:21.106274 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c9a12bd2-e554-412c-ad43-9392c2580d7d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:21.107061 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c9a12bd2-e554-412c-ad43-9392c2580d7d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:21.113792 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9a12bd2-e554-412c-ad43-9392c2580d7d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:21.114282 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9a12bd2-e554-412c-ad43-9392c2580d7d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:21.115060 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9a12bd2-e554-412c-ad43-9392c2580d7d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:21.115639 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9a12bd2-e554-412c-ad43-9392c2580d7d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:21.116310 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9a12bd2-e554-412c-ad43-9392c2580d7d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:21.116983 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c9a12bd2-e554-412c-ad43-9392c2580d7d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:21.387500 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-717a8112-5a16-4613-8d6a-8fbb065352a7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:21.388183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-717a8112-5a16-4613-8d6a-8fbb065352a7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:21.397514 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c9a12bd2-e554-412c-ad43-9392c2580d7d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:21.400753 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-717a8112-5a16-4613-8d6a-8fbb065352a7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:21.400753 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-717a8112-5a16-4613-8d6a-8fbb065352a7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:21.406242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-717a8112-5a16-4613-8d6a-8fbb065352a7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:21.406242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-717a8112-5a16-4613-8d6a-8fbb065352a7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:21.406242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-717a8112-5a16-4613-8d6a-8fbb065352a7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:21.406242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-717a8112-5a16-4613-8d6a-8fbb065352a7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:21.414064 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c9a12bd2-e554-412c-ad43-9392c2580d7d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.312136 Sep 15 07:47:21.415912 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 484/951] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:21 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:21.625990 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7379eea9-3826-4b6b-a081-743227666ac8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:21.626910 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7379eea9-3826-4b6b-a081-743227666ac8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:21.635636 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7379eea9-3826-4b6b-a081-743227666ac8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:21.636434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7379eea9-3826-4b6b-a081-743227666ac8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:21.637735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7379eea9-3826-4b6b-a081-743227666ac8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:21.638235 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7379eea9-3826-4b6b-a081-743227666ac8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:21.640138 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7379eea9-3826-4b6b-a081-743227666ac8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:21.640761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7379eea9-3826-4b6b-a081-743227666ac8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:21.642616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-717a8112-5a16-4613-8d6a-8fbb065352a7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:21.676452 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-717a8112-5a16-4613-8d6a-8fbb065352a7 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1313 microversion: 2.1 time: 0.274597 Sep 15 07:47:21.677830 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 468/952] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:21 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:21.702687 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:21.748457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7379eea9-3826-4b6b-a081-743227666ac8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:21.756325 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7379eea9-3826-4b6b-a081-743227666ac8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1210 microversion: 2.1 time: 0.134956 Sep 15 07:47:21.758219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 485/953] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:21 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1210 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:22.441050 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-80e5eb08-b9de-443f-a7a1-7e4d2e05eccc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:22.441765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-80e5eb08-b9de-443f-a7a1-7e4d2e05eccc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:22.461107 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-80e5eb08-b9de-443f-a7a1-7e4d2e05eccc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:22.462646 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-80e5eb08-b9de-443f-a7a1-7e4d2e05eccc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:22.463299 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-80e5eb08-b9de-443f-a7a1-7e4d2e05eccc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:22.464291 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-80e5eb08-b9de-443f-a7a1-7e4d2e05eccc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:22.465864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-80e5eb08-b9de-443f-a7a1-7e4d2e05eccc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:22.466547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-80e5eb08-b9de-443f-a7a1-7e4d2e05eccc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:22.706030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9da11a64-67ac-4915-b1b6-3909706c16fb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:22.706662 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9da11a64-67ac-4915-b1b6-3909706c16fb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:22.716620 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9da11a64-67ac-4915-b1b6-3909706c16fb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:22.717123 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9da11a64-67ac-4915-b1b6-3909706c16fb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:22.719438 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9da11a64-67ac-4915-b1b6-3909706c16fb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:22.719438 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9da11a64-67ac-4915-b1b6-3909706c16fb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:22.719438 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9da11a64-67ac-4915-b1b6-3909706c16fb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:22.719438 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9da11a64-67ac-4915-b1b6-3909706c16fb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:23.178334 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-80e5eb08-b9de-443f-a7a1-7e4d2e05eccc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:23.185732 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9da11a64-67ac-4915-b1b6-3909706c16fb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:23.187464 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-80e5eb08-b9de-443f-a7a1-7e4d2e05eccc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.750880 Sep 15 07:47:23.188043 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 469/954] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:22 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:23.192771 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8573fe2e-ea99-43d6-8e0b-c7931bbbdbaa tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:23.193549 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8573fe2e-ea99-43d6-8e0b-c7931bbbdbaa tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:23.194242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9da11a64-67ac-4915-b1b6-3909706c16fb tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1313 microversion: 2.1 time: 0.496639 Sep 15 07:47:23.199922 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8573fe2e-ea99-43d6-8e0b-c7931bbbdbaa tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:23.200594 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8573fe2e-ea99-43d6-8e0b-c7931bbbdbaa tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:23.201185 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8573fe2e-ea99-43d6-8e0b-c7931bbbdbaa tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:23.202060 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8573fe2e-ea99-43d6-8e0b-c7931bbbdbaa tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:23.202646 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8573fe2e-ea99-43d6-8e0b-c7931bbbdbaa tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:23.203206 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8573fe2e-ea99-43d6-8e0b-c7931bbbdbaa tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:23.206465 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 486/955] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:22 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:23.269827 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-f9be7842-dfc9-4bd2-bc14-f7e2f5061a9d req-04024c31-5206-4df0-bf2e-a8c1d7b212e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4600a1fd-6542-4a0a-b67c-fb313d57eb82", "tag": "59dabb5f-8b21-46b0-96d6-3403654e5154"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:23.287234 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f9be7842-dfc9-4bd2-bc14-f7e2f5061a9d req-04024c31-5206-4df0-bf2e-a8c1d7b212e8 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:23.287728 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f9be7842-dfc9-4bd2-bc14-f7e2f5061a9d req-04024c31-5206-4df0-bf2e-a8c1d7b212e8 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:23.288166 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f9be7842-dfc9-4bd2-bc14-f7e2f5061a9d req-04024c31-5206-4df0-bf2e-a8c1d7b212e8 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:23.329507 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-f9be7842-dfc9-4bd2-bc14-f7e2f5061a9d req-04024c31-5206-4df0-bf2e-a8c1d7b212e8 service nova] Creating event network-changed:59dabb5f-8b21-46b0-96d6-3403654e5154 for instance 4600a1fd-6542-4a0a-b67c-fb313d57eb82 on hv-cinder-82414 Sep 15 07:47:23.339142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-f9be7842-dfc9-4bd2-bc14-f7e2f5061a9d req-04024c31-5206-4df0-bf2e-a8c1d7b212e8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073139 Sep 15 07:47:23.346412 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 487/956] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:47:23.715991 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8573fe2e-ea99-43d6-8e0b-c7931bbbdbaa tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:23.724726 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8573fe2e-ea99-43d6-8e0b-c7931bbbdbaa tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1266 microversion: 2.1 time: 0.535486 Sep 15 07:47:23.725304 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 470/957] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:23 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1266 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:24.214730 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a0d2de81-f03e-405a-8dfe-ccb7bd92c8d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:24.216038 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a0d2de81-f03e-405a-8dfe-ccb7bd92c8d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:24.224281 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0e5f880a-0ad0-42d6-b5d5-5dc19ae65757 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:24.225678 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0e5f880a-0ad0-42d6-b5d5-5dc19ae65757 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:24.232815 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e5f880a-0ad0-42d6-b5d5-5dc19ae65757 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:24.233314 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e5f880a-0ad0-42d6-b5d5-5dc19ae65757 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:24.243832 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e5f880a-0ad0-42d6-b5d5-5dc19ae65757 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:24.244982 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0d2de81-f03e-405a-8dfe-ccb7bd92c8d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:24.245619 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0d2de81-f03e-405a-8dfe-ccb7bd92c8d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:24.246080 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0d2de81-f03e-405a-8dfe-ccb7bd92c8d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:24.246826 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0d2de81-f03e-405a-8dfe-ccb7bd92c8d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:24.247289 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0d2de81-f03e-405a-8dfe-ccb7bd92c8d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:24.251425 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a0d2de81-f03e-405a-8dfe-ccb7bd92c8d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:24.251571 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e5f880a-0ad0-42d6-b5d5-5dc19ae65757 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:24.251571 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e5f880a-0ad0-42d6-b5d5-5dc19ae65757 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:24.251571 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0e5f880a-0ad0-42d6-b5d5-5dc19ae65757 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:24.646439 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a0d2de81-f03e-405a-8dfe-ccb7bd92c8d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:24.662722 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a0d2de81-f03e-405a-8dfe-ccb7bd92c8d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.453992 Sep 15 07:47:24.674690 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 488/958] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:24 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:24.750515 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-54ddba7d-1d07-4c47-b2f6-955e489996a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:24.751375 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-54ddba7d-1d07-4c47-b2f6-955e489996a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:24.757896 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-54ddba7d-1d07-4c47-b2f6-955e489996a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:24.758464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-54ddba7d-1d07-4c47-b2f6-955e489996a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:24.759259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-54ddba7d-1d07-4c47-b2f6-955e489996a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:24.760552 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-54ddba7d-1d07-4c47-b2f6-955e489996a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:24.761010 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-54ddba7d-1d07-4c47-b2f6-955e489996a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:24.761632 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-54ddba7d-1d07-4c47-b2f6-955e489996a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:24.763515 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0e5f880a-0ad0-42d6-b5d5-5dc19ae65757 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:24.767931 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:24.774139 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0e5f880a-0ad0-42d6-b5d5-5dc19ae65757 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1313 microversion: 2.1 time: 0.553829 Sep 15 07:47:24.782183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 471/959] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:24 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1313 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:24.957610 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-54ddba7d-1d07-4c47-b2f6-955e489996a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:24.968347 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-54ddba7d-1d07-4c47-b2f6-955e489996a8 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1266 microversion: 2.1 time: 0.221732 Sep 15 07:47:24.969481 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 489/960] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:24 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:25.687624 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0ba202a5-17d2-44cc-b038-5203328b80c2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:25.688542 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0ba202a5-17d2-44cc-b038-5203328b80c2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:25.694000 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:25.697813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ba202a5-17d2-44cc-b038-5203328b80c2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:25.698512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ba202a5-17d2-44cc-b038-5203328b80c2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:25.699116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ba202a5-17d2-44cc-b038-5203328b80c2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:25.700346 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ba202a5-17d2-44cc-b038-5203328b80c2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:25.700988 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ba202a5-17d2-44cc-b038-5203328b80c2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:25.701875 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0ba202a5-17d2-44cc-b038-5203328b80c2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:25.802435 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d80b3d6f-47f9-45a1-b31d-14f2069030a4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:25.803199 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d80b3d6f-47f9-45a1-b31d-14f2069030a4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:25.811457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d80b3d6f-47f9-45a1-b31d-14f2069030a4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:25.812299 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d80b3d6f-47f9-45a1-b31d-14f2069030a4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:25.813127 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d80b3d6f-47f9-45a1-b31d-14f2069030a4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:25.813931 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d80b3d6f-47f9-45a1-b31d-14f2069030a4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:25.814389 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d80b3d6f-47f9-45a1-b31d-14f2069030a4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:25.814816 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d80b3d6f-47f9-45a1-b31d-14f2069030a4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:26.008819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0ba202a5-17d2-44cc-b038-5203328b80c2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:26.028922 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0ba202a5-17d2-44cc-b038-5203328b80c2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.345317 Sep 15 07:47:26.029766 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 472/961] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:25 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:26.036723 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-21bcc082-31e0-466d-9315-696f1031f146 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:26.037522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-21bcc082-31e0-466d-9315-696f1031f146 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:26.046177 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21bcc082-31e0-466d-9315-696f1031f146 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:26.047021 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21bcc082-31e0-466d-9315-696f1031f146 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:26.048560 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21bcc082-31e0-466d-9315-696f1031f146 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:26.051654 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21bcc082-31e0-466d-9315-696f1031f146 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:26.051654 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21bcc082-31e0-466d-9315-696f1031f146 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:26.058126 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-21bcc082-31e0-466d-9315-696f1031f146 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:26.087884 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d80b3d6f-47f9-45a1-b31d-14f2069030a4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:26.099170 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d80b3d6f-47f9-45a1-b31d-14f2069030a4 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1313 microversion: 2.1 time: 0.303345 Sep 15 07:47:26.113791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 490/962] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:25 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:26.546030 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-a6726468-b14f-4f3f-86a9-8083b33978f4 req-1e5308b8-4d23-4465-9b39-478eee6eef94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec05c81-a578-4380-b05f-7e4eab9f2103", "name": "network-vif-plugged", "status": "completed", "tag": "1b7de612-7337-4798-8d30-8d58396efb98"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:26.557864 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-a6726468-b14f-4f3f-86a9-8083b33978f4 req-1e5308b8-4d23-4465-9b39-478eee6eef94 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:26.558652 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-a6726468-b14f-4f3f-86a9-8083b33978f4 req-1e5308b8-4d23-4465-9b39-478eee6eef94 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:26.559147 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-a6726468-b14f-4f3f-86a9-8083b33978f4 req-1e5308b8-4d23-4465-9b39-478eee6eef94 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:26.573145 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-21bcc082-31e0-466d-9315-696f1031f146 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:26.578353 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-a6726468-b14f-4f3f-86a9-8083b33978f4 req-1e5308b8-4d23-4465-9b39-478eee6eef94 service nova] Creating event network-vif-plugged:1b7de612-7337-4798-8d30-8d58396efb98 for instance eec05c81-a578-4380-b05f-7e4eab9f2103 on hv-cinder-82414 Sep 15 07:47:26.581036 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-21bcc082-31e0-466d-9315-696f1031f146 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1266 microversion: 2.1 time: 0.549482 Sep 15 07:47:26.581955 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 473/963] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:26 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1266 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:26.584211 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-a6726468-b14f-4f3f-86a9-8083b33978f4 req-1e5308b8-4d23-4465-9b39-478eee6eef94 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042377 Sep 15 07:47:26.584799 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 491/964] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:47:27.054244 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9fa19430-e565-4c91-bf49-7a0184eeb2e9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:27.055004 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-9fa19430-e565-4c91-bf49-7a0184eeb2e9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:27.062934 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9fa19430-e565-4c91-bf49-7a0184eeb2e9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:27.063521 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9fa19430-e565-4c91-bf49-7a0184eeb2e9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:27.064836 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9fa19430-e565-4c91-bf49-7a0184eeb2e9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:27.066056 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9fa19430-e565-4c91-bf49-7a0184eeb2e9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:27.066618 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9fa19430-e565-4c91-bf49-7a0184eeb2e9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:27.067651 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9fa19430-e565-4c91-bf49-7a0184eeb2e9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:27.130684 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-1bda703a-1502-4ee0-b039-23bfe808a960 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:27.132727 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-1bda703a-1502-4ee0-b039-23bfe808a960 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:27.140846 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bda703a-1502-4ee0-b039-23bfe808a960 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:27.141465 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bda703a-1502-4ee0-b039-23bfe808a960 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:27.142000 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bda703a-1502-4ee0-b039-23bfe808a960 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:27.143017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bda703a-1502-4ee0-b039-23bfe808a960 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:27.143476 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bda703a-1502-4ee0-b039-23bfe808a960 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:27.143969 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-1bda703a-1502-4ee0-b039-23bfe808a960 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:27.371798 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-9fa19430-e565-4c91-bf49-7a0184eeb2e9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:27.386571 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9fa19430-e565-4c91-bf49-7a0184eeb2e9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.336278 Sep 15 07:47:27.394846 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 474/965] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:27 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:27.411066 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-1bda703a-1502-4ee0-b039-23bfe808a960 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:27.419275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-1bda703a-1502-4ee0-b039-23bfe808a960 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1313 microversion: 2.1 time: 0.298170 Sep 15 07:47:27.430976 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 492/966] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:27 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:27.608649 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-84bccda3-e462-4c8b-ae62-b24ab6e76253 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:27.609476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-84bccda3-e462-4c8b-ae62-b24ab6e76253 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:27.616225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84bccda3-e462-4c8b-ae62-b24ab6e76253 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:27.616890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84bccda3-e462-4c8b-ae62-b24ab6e76253 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:27.618096 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84bccda3-e462-4c8b-ae62-b24ab6e76253 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:27.619130 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84bccda3-e462-4c8b-ae62-b24ab6e76253 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:27.619911 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84bccda3-e462-4c8b-ae62-b24ab6e76253 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:27.620583 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84bccda3-e462-4c8b-ae62-b24ab6e76253 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:27.772700 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-84bccda3-e462-4c8b-ae62-b24ab6e76253 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:27.783429 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-84bccda3-e462-4c8b-ae62-b24ab6e76253 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1266 microversion: 2.1 time: 0.178925 Sep 15 07:47:27.784098 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 475/967] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:27 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:28.411831 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-de06cea3-cbec-4ab4-93cc-f138abc9abbb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:28.412589 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-de06cea3-cbec-4ab4-93cc-f138abc9abbb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:28.415253 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:28.415939 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=8 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:28.421478 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de06cea3-cbec-4ab4-93cc-f138abc9abbb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:28.426995 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de06cea3-cbec-4ab4-93cc-f138abc9abbb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:28.426995 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de06cea3-cbec-4ab4-93cc-f138abc9abbb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:28.426995 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de06cea3-cbec-4ab4-93cc-f138abc9abbb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:28.426995 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de06cea3-cbec-4ab4-93cc-f138abc9abbb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:28.427430 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-de06cea3-cbec-4ab4-93cc-f138abc9abbb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:28.443588 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-09638de1-ed25-488b-b77b-0023d2ad6d19 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:28.444210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-09638de1-ed25-488b-b77b-0023d2ad6d19 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:28.451260 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=8 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:28.453758 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-09638de1-ed25-488b-b77b-0023d2ad6d19 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:28.454280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-09638de1-ed25-488b-b77b-0023d2ad6d19 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:28.455944 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-09638de1-ed25-488b-b77b-0023d2ad6d19 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:28.457462 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-09638de1-ed25-488b-b77b-0023d2ad6d19 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:28.458388 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-09638de1-ed25-488b-b77b-0023d2ad6d19 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:28.459421 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-09638de1-ed25-488b-b77b-0023d2ad6d19 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:28.639890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-de06cea3-cbec-4ab4-93cc-f138abc9abbb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:28.649421 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-de06cea3-cbec-4ab4-93cc-f138abc9abbb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.241465 Sep 15 07:47:28.654897 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 493/968] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:28 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:28.665777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-09638de1-ed25-488b-b77b-0023d2ad6d19 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:28.674197 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-09638de1-ed25-488b-b77b-0023d2ad6d19 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1497 microversion: 2.1 time: 0.234876 Sep 15 07:47:28.674863 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 476/969] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:28 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1497 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:28.806570 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-28e6d49f-2b66-4191-833c-cd4624ec7280 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:28.807174 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-28e6d49f-2b66-4191-833c-cd4624ec7280 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:28.814425 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28e6d49f-2b66-4191-833c-cd4624ec7280 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:28.814425 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28e6d49f-2b66-4191-833c-cd4624ec7280 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:28.814425 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28e6d49f-2b66-4191-833c-cd4624ec7280 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:28.815292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28e6d49f-2b66-4191-833c-cd4624ec7280 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:28.815292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28e6d49f-2b66-4191-833c-cd4624ec7280 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:28.815751 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28e6d49f-2b66-4191-833c-cd4624ec7280 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:28.953876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-28e6d49f-2b66-4191-833c-cd4624ec7280 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:28.970111 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-28e6d49f-2b66-4191-833c-cd4624ec7280 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1266 microversion: 2.1 time: 0.167953 Sep 15 07:47:28.985512 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 494/970] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:28 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:29.634617 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5ab1cc03-07c0-4204-940e-8d47a27b5fe9 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:29.635892 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5ab1cc03-07c0-4204-940e-8d47a27b5fe9 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:29.642866 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ab1cc03-07c0-4204-940e-8d47a27b5fe9 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:29.643474 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ab1cc03-07c0-4204-940e-8d47a27b5fe9 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:29.644174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ab1cc03-07c0-4204-940e-8d47a27b5fe9 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:29.644980 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ab1cc03-07c0-4204-940e-8d47a27b5fe9 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:29.646834 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ab1cc03-07c0-4204-940e-8d47a27b5fe9 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:29.647391 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ab1cc03-07c0-4204-940e-8d47a27b5fe9 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:29.676016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c6535192-8ebb-4218-83b8-0e639236e62e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:29.677299 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c6535192-8ebb-4218-83b8-0e639236e62e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:29.680199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5ab1cc03-07c0-4204-940e-8d47a27b5fe9 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Going to try to terminate instance {{(pid=132673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:47:29.685612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6535192-8ebb-4218-83b8-0e639236e62e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:29.686362 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6535192-8ebb-4218-83b8-0e639236e62e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:29.687507 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6535192-8ebb-4218-83b8-0e639236e62e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:29.688417 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6535192-8ebb-4218-83b8-0e639236e62e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:29.689090 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6535192-8ebb-4218-83b8-0e639236e62e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:29.689759 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c6535192-8ebb-4218-83b8-0e639236e62e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:29.836693 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c6535192-8ebb-4218-83b8-0e639236e62e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:29.845640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c6535192-8ebb-4218-83b8-0e639236e62e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.173345 Sep 15 07:47:29.846417 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 495/971] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:29 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:29.997356 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-85d0d2e5-c6a2-4356-bcf4-22771a38e6fc tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:29.998246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-85d0d2e5-c6a2-4356-bcf4-22771a38e6fc tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:30.010992 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85d0d2e5-c6a2-4356-bcf4-22771a38e6fc tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:30.011768 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85d0d2e5-c6a2-4356-bcf4-22771a38e6fc tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:30.012428 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85d0d2e5-c6a2-4356-bcf4-22771a38e6fc tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:30.014309 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85d0d2e5-c6a2-4356-bcf4-22771a38e6fc tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:30.014961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85d0d2e5-c6a2-4356-bcf4-22771a38e6fc tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:30.015583 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-85d0d2e5-c6a2-4356-bcf4-22771a38e6fc tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:30.128669 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5ab1cc03-07c0-4204-940e-8d47a27b5fe9 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 204 len: 0 microversion: 2.1 time: 0.498507 Sep 15 07:47:30.134819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 477/972] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:47:29 2022] DELETE /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:47:30.143044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bd7e6873-9e33-4c49-8ec6-779e99bcd9e2 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:30.151662 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bd7e6873-9e33-4c49-8ec6-779e99bcd9e2 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:30.171167 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-85d0d2e5-c6a2-4356-bcf4-22771a38e6fc tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:30.174540 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd7e6873-9e33-4c49-8ec6-779e99bcd9e2 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:30.175172 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd7e6873-9e33-4c49-8ec6-779e99bcd9e2 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:30.175611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd7e6873-9e33-4c49-8ec6-779e99bcd9e2 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:30.176361 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd7e6873-9e33-4c49-8ec6-779e99bcd9e2 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:30.176822 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd7e6873-9e33-4c49-8ec6-779e99bcd9e2 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:30.177251 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bd7e6873-9e33-4c49-8ec6-779e99bcd9e2 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:30.183786 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-85d0d2e5-c6a2-4356-bcf4-22771a38e6fc tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1266 microversion: 2.1 time: 0.191061 Sep 15 07:47:30.190232 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 496/973] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:29 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:30.327895 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bd7e6873-9e33-4c49-8ec6-779e99bcd9e2 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:30.336594 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bd7e6873-9e33-4c49-8ec6-779e99bcd9e2 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1503 microversion: 2.1 time: 0.199529 Sep 15 07:47:30.337238 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 478/974] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:30 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:30.870389 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d2957559-f88d-496e-94e8-2e04438c41c0 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:30.871021 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-d2957559-f88d-496e-94e8-2e04438c41c0 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:30.877781 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2957559-f88d-496e-94e8-2e04438c41c0 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:30.878301 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2957559-f88d-496e-94e8-2e04438c41c0 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:30.878725 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2957559-f88d-496e-94e8-2e04438c41c0 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:30.879431 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2957559-f88d-496e-94e8-2e04438c41c0 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:30.879890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2957559-f88d-496e-94e8-2e04438c41c0 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:30.880326 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-d2957559-f88d-496e-94e8-2e04438c41c0 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:31.057129 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-d2957559-f88d-496e-94e8-2e04438c41c0 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:31.067297 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d2957559-f88d-496e-94e8-2e04438c41c0 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1724 microversion: 2.1 time: 0.200468 Sep 15 07:47:31.084017 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 497/975] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:30 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:31.207312 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6b80f0fd-4c96-48bf-8413-2e26a25cdd9e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:31.207926 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6b80f0fd-4c96-48bf-8413-2e26a25cdd9e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:31.215497 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b80f0fd-4c96-48bf-8413-2e26a25cdd9e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:31.216254 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b80f0fd-4c96-48bf-8413-2e26a25cdd9e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:31.216853 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b80f0fd-4c96-48bf-8413-2e26a25cdd9e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:31.217765 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b80f0fd-4c96-48bf-8413-2e26a25cdd9e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:31.218375 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b80f0fd-4c96-48bf-8413-2e26a25cdd9e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:31.218975 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b80f0fd-4c96-48bf-8413-2e26a25cdd9e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:31.361468 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0b785656-c71d-4fc1-855d-afe4f060e63b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:31.362444 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0b785656-c71d-4fc1-855d-afe4f060e63b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:31.370581 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b785656-c71d-4fc1-855d-afe4f060e63b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:31.370581 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b785656-c71d-4fc1-855d-afe4f060e63b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:31.370581 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b785656-c71d-4fc1-855d-afe4f060e63b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:31.371716 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b785656-c71d-4fc1-855d-afe4f060e63b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:31.372396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b785656-c71d-4fc1-855d-afe4f060e63b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:31.372990 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0b785656-c71d-4fc1-855d-afe4f060e63b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:31.383772 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6b80f0fd-4c96-48bf-8413-2e26a25cdd9e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:31.392245 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6b80f0fd-4c96-48bf-8413-2e26a25cdd9e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1266 microversion: 2.1 time: 0.188622 Sep 15 07:47:31.392883 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 479/976] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:31 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:31.554368 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0b785656-c71d-4fc1-855d-afe4f060e63b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:31.563895 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0b785656-c71d-4fc1-855d-afe4f060e63b tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1503 microversion: 2.1 time: 0.206738 Sep 15 07:47:31.564907 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 498/977] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:31 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:32.093070 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8ffbe59a-1817-42bf-a7bb-ba7fdc3301fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:32.093830 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8ffbe59a-1817-42bf-a7bb-ba7fdc3301fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:32.109516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8ffbe59a-1817-42bf-a7bb-ba7fdc3301fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:32.110371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8ffbe59a-1817-42bf-a7bb-ba7fdc3301fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:32.110904 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8ffbe59a-1817-42bf-a7bb-ba7fdc3301fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:32.114108 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8ffbe59a-1817-42bf-a7bb-ba7fdc3301fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:32.115316 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8ffbe59a-1817-42bf-a7bb-ba7fdc3301fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:32.118050 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8ffbe59a-1817-42bf-a7bb-ba7fdc3301fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:32.340022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8ffbe59a-1817-42bf-a7bb-ba7fdc3301fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:32.356955 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8ffbe59a-1817-42bf-a7bb-ba7fdc3301fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1701 microversion: 2.1 time: 0.268229 Sep 15 07:47:32.359125 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 480/978] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:32 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1701 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:32.385040 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-bc0a5927-600c-459b-bda6-7aed214aaf45 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:32.404343 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc0a5927-600c-459b-bda6-7aed214aaf45 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:32.405108 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc0a5927-600c-459b-bda6-7aed214aaf45 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:32.405764 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-bc0a5927-600c-459b-bda6-7aed214aaf45 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:32.423177 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a2a48436-0543-4961-9771-a136a862c89a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:32.423818 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a2a48436-0543-4961-9771-a136a862c89a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:32.433257 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a2a48436-0543-4961-9771-a136a862c89a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:32.433979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a2a48436-0543-4961-9771-a136a862c89a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:32.434428 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a2a48436-0543-4961-9771-a136a862c89a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:32.435325 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a2a48436-0543-4961-9771-a136a862c89a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:32.435797 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a2a48436-0543-4961-9771-a136a862c89a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:32.436228 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a2a48436-0543-4961-9771-a136a862c89a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:32.488012 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-bc0a5927-600c-459b-bda6-7aed214aaf45 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Going to try to start instance {{(pid=132674) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 07:47:32.645210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a2a48436-0543-4961-9771-a136a862c89a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:32.661247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a2a48436-0543-4961-9771-a136a862c89a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1266 microversion: 2.1 time: 0.248613 Sep 15 07:47:32.679921 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 481/979] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:32 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:32.686504 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-10a52f25-2eb9-4213-8fa9-9d161df4cf03 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:32.689676 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-10a52f25-2eb9-4213-8fa9-9d161df4cf03 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:32.693762 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10a52f25-2eb9-4213-8fa9-9d161df4cf03 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:32.694398 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10a52f25-2eb9-4213-8fa9-9d161df4cf03 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:32.695547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10a52f25-2eb9-4213-8fa9-9d161df4cf03 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:32.696771 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10a52f25-2eb9-4213-8fa9-9d161df4cf03 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:32.697455 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10a52f25-2eb9-4213-8fa9-9d161df4cf03 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:32.698101 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-10a52f25-2eb9-4213-8fa9-9d161df4cf03 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:32.765108 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-bc0a5927-600c-459b-bda6-7aed214aaf45 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "POST /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/action" status: 202 len: 0 microversion: 2.1 time: 0.385575 Sep 15 07:47:32.766185 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 499/980] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:47:32 2022] POST /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 07:47:32.775948 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6317b8ab-90a4-4dde-b7ed-5ad72181c41f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:32.778457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6317b8ab-90a4-4dde-b7ed-5ad72181c41f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:32.797679 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6317b8ab-90a4-4dde-b7ed-5ad72181c41f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:32.799761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6317b8ab-90a4-4dde-b7ed-5ad72181c41f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:32.800440 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6317b8ab-90a4-4dde-b7ed-5ad72181c41f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:32.803738 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6317b8ab-90a4-4dde-b7ed-5ad72181c41f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:32.804295 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6317b8ab-90a4-4dde-b7ed-5ad72181c41f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:32.805748 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6317b8ab-90a4-4dde-b7ed-5ad72181c41f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:32.813928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-10a52f25-2eb9-4213-8fa9-9d161df4cf03 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:32.823833 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-10a52f25-2eb9-4213-8fa9-9d161df4cf03 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1461 microversion: 2.1 time: 0.142573 Sep 15 07:47:32.824438 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 482/981] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:32 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1461 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:33.012456 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6317b8ab-90a4-4dde-b7ed-5ad72181c41f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:33.021328 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6317b8ab-90a4-4dde-b7ed-5ad72181c41f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1710 microversion: 2.1 time: 0.250606 Sep 15 07:47:33.022580 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 500/982] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:32 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1710 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:33.188659 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-3eeef7b0-160b-4071-8048-51dd49018661 req-72e5a6c1-e659-4710-bdef-1aa97598dd6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec05c81-a578-4380-b05f-7e4eab9f2103", "name": "network-vif-deleted", "tag": "1b7de612-7337-4798-8d30-8d58396efb98"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:33.206324 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-3eeef7b0-160b-4071-8048-51dd49018661 req-72e5a6c1-e659-4710-bdef-1aa97598dd6a service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:33.206809 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-3eeef7b0-160b-4071-8048-51dd49018661 req-72e5a6c1-e659-4710-bdef-1aa97598dd6a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:33.207239 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-3eeef7b0-160b-4071-8048-51dd49018661 req-72e5a6c1-e659-4710-bdef-1aa97598dd6a service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:33.227040 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-3eeef7b0-160b-4071-8048-51dd49018661 req-72e5a6c1-e659-4710-bdef-1aa97598dd6a service nova] Creating event network-vif-deleted:1b7de612-7337-4798-8d30-8d58396efb98 for instance eec05c81-a578-4380-b05f-7e4eab9f2103 on hv-cinder-82414 Sep 15 07:47:33.233118 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-3eeef7b0-160b-4071-8048-51dd49018661 req-72e5a6c1-e659-4710-bdef-1aa97598dd6a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048034 Sep 15 07:47:33.234357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 483/983] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:47:33.687527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c3b0014c-7e59-4b09-a3fe-4e015dae019e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:33.688207 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c3b0014c-7e59-4b09-a3fe-4e015dae019e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:33.696294 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3b0014c-7e59-4b09-a3fe-4e015dae019e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:33.697132 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3b0014c-7e59-4b09-a3fe-4e015dae019e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:33.697733 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3b0014c-7e59-4b09-a3fe-4e015dae019e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:33.698534 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3b0014c-7e59-4b09-a3fe-4e015dae019e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:33.699058 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3b0014c-7e59-4b09-a3fe-4e015dae019e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:33.699540 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c3b0014c-7e59-4b09-a3fe-4e015dae019e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:33.849464 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:33.850244 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:33.862806 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:33.863298 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:33.863735 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:33.864436 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:33.864892 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:33.865311 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:33.871038 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c3b0014c-7e59-4b09-a3fe-4e015dae019e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:33.880511 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c3b0014c-7e59-4b09-a3fe-4e015dae019e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1266 microversion: 2.1 time: 0.197165 Sep 15 07:47:33.883056 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 501/984] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:33 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:33.912734 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:33.913455 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:33.914907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:33.916132 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lazy-loading 'fault' on Instance uuid eec05c81-a578-4380-b05f-7e4eab9f2103 {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:47:33.984108 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d66f4fd90e74287ae9891e0364ab2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988cf6a6fa2b452e8c4c017f282d144c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:33.995658 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-23a9425c-3035-4e7a-aff8-e47748a22982 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 200 len: 1303 microversion: 2.1 time: 0.148788 Sep 15 07:47:33.996846 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 484/985] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:33 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:34.045500 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c02d6107-d92b-463b-ab8c-a5acaec3a4ba tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:34.046662 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c02d6107-d92b-463b-ab8c-a5acaec3a4ba tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:34.053033 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c02d6107-d92b-463b-ab8c-a5acaec3a4ba tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:34.053650 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c02d6107-d92b-463b-ab8c-a5acaec3a4ba tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:34.054113 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c02d6107-d92b-463b-ab8c-a5acaec3a4ba tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:34.054951 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c02d6107-d92b-463b-ab8c-a5acaec3a4ba tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:34.055409 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c02d6107-d92b-463b-ab8c-a5acaec3a4ba tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:34.055832 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c02d6107-d92b-463b-ab8c-a5acaec3a4ba tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:34.060924 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:34.224762 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c02d6107-d92b-463b-ab8c-a5acaec3a4ba tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:34.234713 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c02d6107-d92b-463b-ab8c-a5acaec3a4ba tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1710 microversion: 2.1 time: 0.193038 Sep 15 07:47:34.235321 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 502/986] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:34 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1710 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:34.584921 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-fb512420-ac07-4df5-916b-b192e1361e04 req-756f84f6-8878-446f-911d-7184b4f80396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4600a1fd-6542-4a0a-b67c-fb313d57eb82", "name": "network-vif-plugged", "status": "completed", "tag": "59dabb5f-8b21-46b0-96d6-3403654e5154"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:34.615128 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-fb512420-ac07-4df5-916b-b192e1361e04 req-756f84f6-8878-446f-911d-7184b4f80396 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:34.619445 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-fb512420-ac07-4df5-916b-b192e1361e04 req-756f84f6-8878-446f-911d-7184b4f80396 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:34.619567 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-fb512420-ac07-4df5-916b-b192e1361e04 req-756f84f6-8878-446f-911d-7184b4f80396 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:34.631918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-fb512420-ac07-4df5-916b-b192e1361e04 req-756f84f6-8878-446f-911d-7184b4f80396 service nova] Creating event network-vif-plugged:59dabb5f-8b21-46b0-96d6-3403654e5154 for instance 4600a1fd-6542-4a0a-b67c-fb313d57eb82 on hv-cinder-82414 Sep 15 07:47:34.639065 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-fb512420-ac07-4df5-916b-b192e1361e04 req-756f84f6-8878-446f-911d-7184b4f80396 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060011 Sep 15 07:47:34.639677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 485/987] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:47:34.904877 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-cfd47244-7e41-4ac8-8bc3-49258bfbd111 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:34.905493 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-cfd47244-7e41-4ac8-8bc3-49258bfbd111 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:34.913588 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cfd47244-7e41-4ac8-8bc3-49258bfbd111 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:34.914320 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cfd47244-7e41-4ac8-8bc3-49258bfbd111 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:34.915050 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cfd47244-7e41-4ac8-8bc3-49258bfbd111 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:34.915762 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cfd47244-7e41-4ac8-8bc3-49258bfbd111 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:34.916210 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cfd47244-7e41-4ac8-8bc3-49258bfbd111 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:34.916806 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-cfd47244-7e41-4ac8-8bc3-49258bfbd111 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:35.019097 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:35.019796 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] [instance: eec05c81-a578-4380-b05f-7e4eab9f2103] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:35.026135 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:35.026627 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:35.027067 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:35.027960 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:35.028617 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:35.029046 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:35.044457 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] HTTP exception thrown: Instance eec05c81-a578-4380-b05f-7e4eab9f2103 could not be found. Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Request method failure captured: Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 HTTP/1.1 Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjIthi59iNVrc7PSqDn0xVi7EskaUsimim4bxIu6ltcdJuCRlbf7MsIPQEAtVE5cHSdKSd91CPQIEv-SVd1WVc4tynGEwyfwsWOzf-kdyLu-RBCoa5lo1FLdAwQBlCuRgzWyK5RRWvajbFsL9re0ZWEa78IR6uE9Y8a84saDvCaAo3WJ8 Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 988cf6a6fa2b452e8c4c017f282d144c Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-VolumesActionsTest-601705062 Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:47:35.046198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_988cf6a6fa2b452e8c4c017f282d144c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/988cf6a6fa2b452e8c4c017f282d144c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/988cf6a6fa2b452e8c4c017f282d144c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/988cf6a6fa2b452e8c4c017f282d144c"}]}] Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-VolumesActionsTest-601705062 Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 988cf6a6fa2b452e8c4c017f282d144c Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-VolumesActionsTest-601705062 Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-VolumesActionsTest-601705062-project Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: 4d66f4fd90e74287ae9891e0364ab2cd Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-VolumesActionsTest-601705062-project Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance eec05c81-a578-4380-b05f-7e4eab9f2103 could not be found. Sep 15 07:47:35.047884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': 'eec05c81-a578-4380-b05f-7e4eab9f2103'} Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec05c81-a578-4380-b05f-7e4eab9f2103 could not be found. Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:47:35.048807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec05c81-a578-4380-b05f-7e4eab9f2103 could not be found. Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec05c81-a578-4380-b05f-7e4eab9f2103 could not be found. Sep 15 07:47:35.050247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:47:35.052112 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] Returning 404 to user: Instance eec05c81-a578-4380-b05f-7e4eab9f2103 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:47:35.053127 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a04efc4d-c905-4fdb-aeeb-c192307c0b74 tempest-VolumesActionsTest-601705062 tempest-VolumesActionsTest-601705062-project] 10.222.0.42 "GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103" status: 404 len: 111 microversion: 2.1 time: 0.038222 Sep 15 07:47:35.054718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 486/988] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:35 2022] GET /compute/v2.1/servers/eec05c81-a578-4380-b05f-7e4eab9f2103 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 07:47:35.143799 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-cfd47244-7e41-4ac8-8bc3-49258bfbd111 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:35.153886 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-cfd47244-7e41-4ac8-8bc3-49258bfbd111 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1266 microversion: 2.1 time: 0.253177 Sep 15 07:47:35.179947 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 503/989] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:34 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:35.258773 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7a596b42-de8f-412f-b042-94442f54b3fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:35.259702 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7a596b42-de8f-412f-b042-94442f54b3fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:35.267847 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a596b42-de8f-412f-b042-94442f54b3fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:35.271889 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a596b42-de8f-412f-b042-94442f54b3fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:35.271889 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a596b42-de8f-412f-b042-94442f54b3fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:35.271889 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a596b42-de8f-412f-b042-94442f54b3fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:35.277224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a596b42-de8f-412f-b042-94442f54b3fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:35.277816 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7a596b42-de8f-412f-b042-94442f54b3fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:35.447522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7a596b42-de8f-412f-b042-94442f54b3fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:35.472432 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7a596b42-de8f-412f-b042-94442f54b3fa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1714 microversion: 2.1 time: 0.217900 Sep 15 07:47:35.473224 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 487/990] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:35 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1714 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:36.179694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c1959b10-c2c0-40a0-93bb-d0941ecc3b59 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:36.180321 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c1959b10-c2c0-40a0-93bb-d0941ecc3b59 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:36.192813 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c1959b10-c2c0-40a0-93bb-d0941ecc3b59 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:36.193812 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c1959b10-c2c0-40a0-93bb-d0941ecc3b59 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:36.195888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c1959b10-c2c0-40a0-93bb-d0941ecc3b59 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:36.196655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c1959b10-c2c0-40a0-93bb-d0941ecc3b59 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:36.197123 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c1959b10-c2c0-40a0-93bb-d0941ecc3b59 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:36.197560 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c1959b10-c2c0-40a0-93bb-d0941ecc3b59 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:36.420141 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c1959b10-c2c0-40a0-93bb-d0941ecc3b59 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:36.431410 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c1959b10-c2c0-40a0-93bb-d0941ecc3b59 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1266 microversion: 2.1 time: 0.255980 Sep 15 07:47:36.432711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 504/991] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:36 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:37.460751 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-14de2429-66b2-4026-94dd-86f1c0664083 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:37.462119 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-14de2429-66b2-4026-94dd-86f1c0664083 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:37.468787 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14de2429-66b2-4026-94dd-86f1c0664083 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:37.470100 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14de2429-66b2-4026-94dd-86f1c0664083 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:37.472584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14de2429-66b2-4026-94dd-86f1c0664083 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:37.472584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14de2429-66b2-4026-94dd-86f1c0664083 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:37.472584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14de2429-66b2-4026-94dd-86f1c0664083 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:37.472584 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-14de2429-66b2-4026-94dd-86f1c0664083 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:37.500560 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:37.651779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-14de2429-66b2-4026-94dd-86f1c0664083 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:37.661978 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-14de2429-66b2-4026-94dd-86f1c0664083 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1452 microversion: 2.1 time: 0.210420 Sep 15 07:47:37.669722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 488/992] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:37 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1452 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:37.689268 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-efe452b7-20a2-4f36-953d-e351d86743b1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:37.689944 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-efe452b7-20a2-4f36-953d-e351d86743b1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:37.699655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efe452b7-20a2-4f36-953d-e351d86743b1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:37.700412 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efe452b7-20a2-4f36-953d-e351d86743b1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:37.701018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efe452b7-20a2-4f36-953d-e351d86743b1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:37.702092 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efe452b7-20a2-4f36-953d-e351d86743b1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:37.702733 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efe452b7-20a2-4f36-953d-e351d86743b1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:37.703324 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efe452b7-20a2-4f36-953d-e351d86743b1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:37.874084 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-efe452b7-20a2-4f36-953d-e351d86743b1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:37.883293 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-efe452b7-20a2-4f36-953d-e351d86743b1 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1452 microversion: 2.1 time: 0.197823 Sep 15 07:47:37.892892 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 505/993] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:37 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1452 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:41.243489 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-34554985-4f62-4578-afdc-9aa1f0ec3e1d req-7f489a51-7798-4eb5-bab8-368362c3a7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4600a1fd-6542-4a0a-b67c-fb313d57eb82", "tag": "59dabb5f-8b21-46b0-96d6-3403654e5154"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:41.277297 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-34554985-4f62-4578-afdc-9aa1f0ec3e1d req-7f489a51-7798-4eb5-bab8-368362c3a7c2 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:41.278349 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-34554985-4f62-4578-afdc-9aa1f0ec3e1d req-7f489a51-7798-4eb5-bab8-368362c3a7c2 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:41.288541 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-34554985-4f62-4578-afdc-9aa1f0ec3e1d req-7f489a51-7798-4eb5-bab8-368362c3a7c2 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:41.344248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-34554985-4f62-4578-afdc-9aa1f0ec3e1d req-7f489a51-7798-4eb5-bab8-368362c3a7c2 service nova] Creating event network-changed:59dabb5f-8b21-46b0-96d6-3403654e5154 for instance 4600a1fd-6542-4a0a-b67c-fb313d57eb82 on hv-cinder-82414 Sep 15 07:47:41.360305 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-34554985-4f62-4578-afdc-9aa1f0ec3e1d req-7f489a51-7798-4eb5-bab8-368362c3a7c2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120405 Sep 15 07:47:41.360931 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 489/994] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:47:49.932394 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-57c8a3a2-13aa-493a-a51c-6ec6180b506b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Action: 'create', calling method: .version_select at 0x7ff37019d280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-766509561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/L/sDACZsLFJPZP2N/toL8mN1dqG7YaksNZLTCd8Qq2tQTqgD1qvlhDbeDRlhISGqcw7KmM+DUTO2mGd1a7+GBMfinGy+KMJ8wZxjCgIB6Y4BtE+mmAmz5OYwao1dfcQ=="}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:49.947753 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:49.953450 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=22 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:49.970369 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-57c8a3a2-13aa-493a-a51c-6ec6180b506b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Getting quotas for project 00091272c5a745f2bf80723a69fbfc61. Resources: {'key_pairs'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:47:49.974752 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-57c8a3a2-13aa-493a-a51c-6ec6180b506b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Getting quotas for user f4c762318a844714b585f80fdfa9ef53 and project 00091272c5a745f2bf80723a69fbfc61. Resources: {'key_pairs'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:47:50.058673 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-57c8a3a2-13aa-493a-a51c-6ec6180b506b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.131869 Sep 15 07:47:50.062054 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 506/995] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 15 07:47:49 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:47:50.125194 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-441671574", "imageRef": "5aac3ea8-3e66-43e3-92d2-41f6053b32a6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-766509561", "networks": [{"uuid": "970c4a81-43bc-4dcc-bb59-25887f2adff4"}]}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:50.142329 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:47:50.248797 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] validate_networks() for [('970c4a81-43bc-4dcc-bb59-25887f2adff4', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:47:51.012043 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:47:51.012476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:47:51.012956 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:47:51.013371 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:47:51.013839 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:47:51.026099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:51.026503 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:51.026949 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:51.027682 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:51.028145 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:51.028566 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:51.047712 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Getting quotas for project 00091272c5a745f2bf80723a69fbfc61. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:47:51.051972 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Getting quotas for user f4c762318a844714b585f80fdfa9ef53 and project 00091272c5a745f2bf80723a69fbfc61. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:47:51.065192 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:47:51.067658 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5aac3ea8-3e66-43e3-92d2-41f6053b32a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:47:51.236705 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6254e267-65e2-4174-9001-24dad0fc6432 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116915 Sep 15 07:47:51.243451 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 490/996] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:47:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:47:51.250624 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-92f93b50-4dcf-4324-a0e5-3637c26ea9fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:51.251245 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-92f93b50-4dcf-4324-a0e5-3637c26ea9fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:51.311164 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-92f93b50-4dcf-4324-a0e5-3637c26ea9fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:51.321130 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-92f93b50-4dcf-4324-a0e5-3637c26ea9fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1257 microversion: 2.1 time: 0.076409 Sep 15 07:47:51.322279 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 507/997] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:51 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1257 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:52.346292 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-98faba08-8ae9-413a-818a-3d3bcbe58fd0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:52.346972 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-98faba08-8ae9-413a-818a-3d3bcbe58fd0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:52.408459 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-98faba08-8ae9-413a-818a-3d3bcbe58fd0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:52.417059 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-98faba08-8ae9-413a-818a-3d3bcbe58fd0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1257 microversion: 2.1 time: 0.076388 Sep 15 07:47:52.418085 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 491/998] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:52 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1257 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:47:53.443599 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-28f4f0ab-0565-434f-9098-186811a5f792 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:53.445426 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-28f4f0ab-0565-434f-9098-186811a5f792 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:53.454499 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28f4f0ab-0565-434f-9098-186811a5f792 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:53.455622 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28f4f0ab-0565-434f-9098-186811a5f792 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:53.456612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28f4f0ab-0565-434f-9098-186811a5f792 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:53.457686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28f4f0ab-0565-434f-9098-186811a5f792 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:53.458465 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28f4f0ab-0565-434f-9098-186811a5f792 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:53.459098 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-28f4f0ab-0565-434f-9098-186811a5f792 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:53.554554 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-28f4f0ab-0565-434f-9098-186811a5f792 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:53.564266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-28f4f0ab-0565-434f-9098-186811a5f792 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1309 microversion: 2.1 time: 0.126513 Sep 15 07:47:53.565563 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 508/999] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:53 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:54.595423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-41e0cc99-9b53-4fc0-ae6a-31e02cf3f0a7 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:54.596643 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-41e0cc99-9b53-4fc0-ae6a-31e02cf3f0a7 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:54.610236 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e0cc99-9b53-4fc0-ae6a-31e02cf3f0a7 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:54.612356 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e0cc99-9b53-4fc0-ae6a-31e02cf3f0a7 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:54.613151 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e0cc99-9b53-4fc0-ae6a-31e02cf3f0a7 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:54.617616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e0cc99-9b53-4fc0-ae6a-31e02cf3f0a7 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:54.618586 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e0cc99-9b53-4fc0-ae6a-31e02cf3f0a7 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:54.619231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41e0cc99-9b53-4fc0-ae6a-31e02cf3f0a7 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:54.705313 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-41e0cc99-9b53-4fc0-ae6a-31e02cf3f0a7 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:54.717038 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-41e0cc99-9b53-4fc0-ae6a-31e02cf3f0a7 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1317 microversion: 2.1 time: 0.126216 Sep 15 07:47:54.730784 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 492/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:54 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1317 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:55.744651 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6d79668d-c53f-4490-bda3-23b88a196d63 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:55.750154 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6d79668d-c53f-4490-bda3-23b88a196d63 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:55.775210 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d79668d-c53f-4490-bda3-23b88a196d63 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:55.775837 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d79668d-c53f-4490-bda3-23b88a196d63 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:55.776546 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d79668d-c53f-4490-bda3-23b88a196d63 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:55.778417 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d79668d-c53f-4490-bda3-23b88a196d63 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:55.782163 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d79668d-c53f-4490-bda3-23b88a196d63 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:55.782938 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6d79668d-c53f-4490-bda3-23b88a196d63 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:56.056105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6d79668d-c53f-4490-bda3-23b88a196d63 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:56.088243 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6d79668d-c53f-4490-bda3-23b88a196d63 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.347653 Sep 15 07:47:56.089855 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 509/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:55 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:56.883377 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-921c2366-c3d5-4bd0-92a7-e46cff0e3ad6 req-8a123868-9899-4206-a2c1-7971b3f57e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533c974f-14a5-43e3-a746-c3156eae4282", "tag": "9499e9bc-c07e-4389-a2e2-415f7d2c8088"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:47:56.908198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-921c2366-c3d5-4bd0-92a7-e46cff0e3ad6 req-8a123868-9899-4206-a2c1-7971b3f57e4c service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:56.909048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-921c2366-c3d5-4bd0-92a7-e46cff0e3ad6 req-8a123868-9899-4206-a2c1-7971b3f57e4c service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:56.909996 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-921c2366-c3d5-4bd0-92a7-e46cff0e3ad6 req-8a123868-9899-4206-a2c1-7971b3f57e4c service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:56.936314 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-921c2366-c3d5-4bd0-92a7-e46cff0e3ad6 req-8a123868-9899-4206-a2c1-7971b3f57e4c service nova] Creating event network-changed:9499e9bc-c07e-4389-a2e2-415f7d2c8088 for instance 533c974f-14a5-43e3-a746-c3156eae4282 on hv-cinder-82414 Sep 15 07:47:56.946817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-921c2366-c3d5-4bd0-92a7-e46cff0e3ad6 req-8a123868-9899-4206-a2c1-7971b3f57e4c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066881 Sep 15 07:47:56.947606 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 493/1002] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:47:57.122003 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-386f075c-c7f4-4567-b698-4632a392ab56 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:57.124117 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-386f075c-c7f4-4567-b698-4632a392ab56 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:57.138479 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-386f075c-c7f4-4567-b698-4632a392ab56 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:57.144979 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-386f075c-c7f4-4567-b698-4632a392ab56 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:57.145806 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-386f075c-c7f4-4567-b698-4632a392ab56 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:57.146848 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-386f075c-c7f4-4567-b698-4632a392ab56 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:57.148004 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-386f075c-c7f4-4567-b698-4632a392ab56 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:57.148460 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-386f075c-c7f4-4567-b698-4632a392ab56 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:57.387288 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-386f075c-c7f4-4567-b698-4632a392ab56 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:57.409747 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-386f075c-c7f4-4567-b698-4632a392ab56 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.291294 Sep 15 07:47:57.411845 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 510/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:57 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:58.438110 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0356f7c1-03a3-442f-8d53-5cb32229c8ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:58.447184 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0356f7c1-03a3-442f-8d53-5cb32229c8ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:58.450602 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0356f7c1-03a3-442f-8d53-5cb32229c8ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:58.454195 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0356f7c1-03a3-442f-8d53-5cb32229c8ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:58.454875 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0356f7c1-03a3-442f-8d53-5cb32229c8ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:58.455611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0356f7c1-03a3-442f-8d53-5cb32229c8ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:58.456068 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0356f7c1-03a3-442f-8d53-5cb32229c8ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:58.462255 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0356f7c1-03a3-442f-8d53-5cb32229c8ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:58.695516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0356f7c1-03a3-442f-8d53-5cb32229c8ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:58.703398 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0356f7c1-03a3-442f-8d53-5cb32229c8ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.269736 Sep 15 07:47:58.704110 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 494/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:58 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:47:59.728296 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-35e4ff2c-6a48-4b2d-9ec7-86a29df4509f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:47:59.728997 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-35e4ff2c-6a48-4b2d-9ec7-86a29df4509f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:47:59.737162 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35e4ff2c-6a48-4b2d-9ec7-86a29df4509f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:59.737685 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35e4ff2c-6a48-4b2d-9ec7-86a29df4509f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:59.738131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35e4ff2c-6a48-4b2d-9ec7-86a29df4509f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:59.738864 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35e4ff2c-6a48-4b2d-9ec7-86a29df4509f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:47:59.739323 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35e4ff2c-6a48-4b2d-9ec7-86a29df4509f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:47:59.739751 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35e4ff2c-6a48-4b2d-9ec7-86a29df4509f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:47:59.894003 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-35e4ff2c-6a48-4b2d-9ec7-86a29df4509f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:47:59.902451 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-35e4ff2c-6a48-4b2d-9ec7-86a29df4509f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.179314 Sep 15 07:47:59.903024 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 511/1005] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:47:59 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:00.926173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b66f077c-eb20-43b3-8bce-b614b7cd6958 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:00.926788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b66f077c-eb20-43b3-8bce-b614b7cd6958 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:00.933910 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b66f077c-eb20-43b3-8bce-b614b7cd6958 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:00.934387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b66f077c-eb20-43b3-8bce-b614b7cd6958 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:00.934815 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b66f077c-eb20-43b3-8bce-b614b7cd6958 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:00.935501 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b66f077c-eb20-43b3-8bce-b614b7cd6958 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:00.935949 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b66f077c-eb20-43b3-8bce-b614b7cd6958 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:00.936368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b66f077c-eb20-43b3-8bce-b614b7cd6958 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:01.038731 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:01.079809 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b66f077c-eb20-43b3-8bce-b614b7cd6958 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:01.089020 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b66f077c-eb20-43b3-8bce-b614b7cd6958 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.166611 Sep 15 07:48:01.089611 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 495/1006] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:00 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:02.111726 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-43c9d2c7-7427-49fd-9c12-8f13a0244538 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:02.112369 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-43c9d2c7-7427-49fd-9c12-8f13a0244538 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:02.115337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=6 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:02.120086 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43c9d2c7-7427-49fd-9c12-8f13a0244538 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:02.120566 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43c9d2c7-7427-49fd-9c12-8f13a0244538 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:02.121003 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43c9d2c7-7427-49fd-9c12-8f13a0244538 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:02.121881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43c9d2c7-7427-49fd-9c12-8f13a0244538 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:02.122333 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43c9d2c7-7427-49fd-9c12-8f13a0244538 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:02.122763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-43c9d2c7-7427-49fd-9c12-8f13a0244538 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:02.340629 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-43c9d2c7-7427-49fd-9c12-8f13a0244538 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:02.348697 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-43c9d2c7-7427-49fd-9c12-8f13a0244538 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.240925 Sep 15 07:48:02.349889 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 512/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:02 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:03.374028 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f471dc22-0b3b-4b7d-ba31-ce78afbcd359 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:03.375570 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f471dc22-0b3b-4b7d-ba31-ce78afbcd359 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:03.383570 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=8 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:03.385779 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f471dc22-0b3b-4b7d-ba31-ce78afbcd359 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:03.386363 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f471dc22-0b3b-4b7d-ba31-ce78afbcd359 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:03.386965 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f471dc22-0b3b-4b7d-ba31-ce78afbcd359 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:03.387984 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f471dc22-0b3b-4b7d-ba31-ce78afbcd359 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:03.389087 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f471dc22-0b3b-4b7d-ba31-ce78afbcd359 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:03.389948 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f471dc22-0b3b-4b7d-ba31-ce78afbcd359 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:03.562896 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f471dc22-0b3b-4b7d-ba31-ce78afbcd359 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:03.571306 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f471dc22-0b3b-4b7d-ba31-ce78afbcd359 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.202456 Sep 15 07:48:03.571891 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 496/1008] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:03 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:04.596889 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-affc0b21-a546-401a-ab1b-7741eaf3efb0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:04.597773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-affc0b21-a546-401a-ab1b-7741eaf3efb0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:04.606989 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-affc0b21-a546-401a-ab1b-7741eaf3efb0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:04.607487 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-affc0b21-a546-401a-ab1b-7741eaf3efb0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:04.607924 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-affc0b21-a546-401a-ab1b-7741eaf3efb0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:04.608633 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-affc0b21-a546-401a-ab1b-7741eaf3efb0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:04.609087 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-affc0b21-a546-401a-ab1b-7741eaf3efb0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:04.609514 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-affc0b21-a546-401a-ab1b-7741eaf3efb0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:04.750763 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-affc0b21-a546-401a-ab1b-7741eaf3efb0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:04.760031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-affc0b21-a546-401a-ab1b-7741eaf3efb0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.167568 Sep 15 07:48:04.776048 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 513/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:04 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:05.784610 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-11bfb88a-c823-4e84-b8d1-45136ef30a54 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:05.785258 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-11bfb88a-c823-4e84-b8d1-45136ef30a54 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:05.793008 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11bfb88a-c823-4e84-b8d1-45136ef30a54 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:05.794658 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11bfb88a-c823-4e84-b8d1-45136ef30a54 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:05.794658 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11bfb88a-c823-4e84-b8d1-45136ef30a54 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:05.794658 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11bfb88a-c823-4e84-b8d1-45136ef30a54 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:05.795082 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11bfb88a-c823-4e84-b8d1-45136ef30a54 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:05.795536 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-11bfb88a-c823-4e84-b8d1-45136ef30a54 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:06.134988 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-11bfb88a-c823-4e84-b8d1-45136ef30a54 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:06.142588 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-11bfb88a-c823-4e84-b8d1-45136ef30a54 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.362006 Sep 15 07:48:06.143157 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 497/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:05 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:07.165951 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-4ca25539-0a4d-4920-82c3-e59432d065a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:07.166713 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-4ca25539-0a4d-4920-82c3-e59432d065a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:07.176208 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ca25539-0a4d-4920-82c3-e59432d065a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:07.176208 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ca25539-0a4d-4920-82c3-e59432d065a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:07.176208 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ca25539-0a4d-4920-82c3-e59432d065a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:07.176208 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ca25539-0a4d-4920-82c3-e59432d065a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:07.176674 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ca25539-0a4d-4920-82c3-e59432d065a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:07.177531 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-4ca25539-0a4d-4920-82c3-e59432d065a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:07.308111 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-4ca25539-0a4d-4920-82c3-e59432d065a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:07.315715 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-4ca25539-0a4d-4920-82c3-e59432d065a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.154658 Sep 15 07:48:07.316281 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 514/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:07 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:08.338916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bda8ac34-9dfd-426e-b093-bf34b3d83a7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:08.339614 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-bda8ac34-9dfd-426e-b093-bf34b3d83a7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:08.346457 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bda8ac34-9dfd-426e-b093-bf34b3d83a7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:08.347067 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bda8ac34-9dfd-426e-b093-bf34b3d83a7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:08.347569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bda8ac34-9dfd-426e-b093-bf34b3d83a7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:08.348325 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bda8ac34-9dfd-426e-b093-bf34b3d83a7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:08.350245 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bda8ac34-9dfd-426e-b093-bf34b3d83a7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:08.350777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-bda8ac34-9dfd-426e-b093-bf34b3d83a7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:08.481871 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-bda8ac34-9dfd-426e-b093-bf34b3d83a7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:08.489474 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bda8ac34-9dfd-426e-b093-bf34b3d83a7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.154436 Sep 15 07:48:08.490287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 498/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:08 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:09.512289 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0e0025c3-8c6f-461d-b09f-3cf21865f6d6 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:09.512932 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0e0025c3-8c6f-461d-b09f-3cf21865f6d6 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:09.519299 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0e0025c3-8c6f-461d-b09f-3cf21865f6d6 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:09.519779 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0e0025c3-8c6f-461d-b09f-3cf21865f6d6 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:09.520253 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0e0025c3-8c6f-461d-b09f-3cf21865f6d6 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:09.521244 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0e0025c3-8c6f-461d-b09f-3cf21865f6d6 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:09.521743 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0e0025c3-8c6f-461d-b09f-3cf21865f6d6 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:09.522175 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0e0025c3-8c6f-461d-b09f-3cf21865f6d6 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:09.656276 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0e0025c3-8c6f-461d-b09f-3cf21865f6d6 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:09.664377 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0e0025c3-8c6f-461d-b09f-3cf21865f6d6 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.156040 Sep 15 07:48:09.665006 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 515/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:09 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:10.688330 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7bb93bc8-6d0f-48d2-a1fa-a461731af20b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:10.689064 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7bb93bc8-6d0f-48d2-a1fa-a461731af20b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:10.696329 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7bb93bc8-6d0f-48d2-a1fa-a461731af20b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:10.696889 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7bb93bc8-6d0f-48d2-a1fa-a461731af20b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:10.697331 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7bb93bc8-6d0f-48d2-a1fa-a461731af20b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:10.698148 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7bb93bc8-6d0f-48d2-a1fa-a461731af20b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:10.698600 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7bb93bc8-6d0f-48d2-a1fa-a461731af20b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:10.699017 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7bb93bc8-6d0f-48d2-a1fa-a461731af20b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:10.832369 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7bb93bc8-6d0f-48d2-a1fa-a461731af20b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:10.840767 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7bb93bc8-6d0f-48d2-a1fa-a461731af20b tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.156653 Sep 15 07:48:10.841334 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 499/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:10 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:11.864131 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c00bad12-5c15-4965-8ae7-06c43f9f68ac tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:11.864753 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c00bad12-5c15-4965-8ae7-06c43f9f68ac tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:11.871101 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c00bad12-5c15-4965-8ae7-06c43f9f68ac tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:11.871589 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c00bad12-5c15-4965-8ae7-06c43f9f68ac tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:11.872025 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c00bad12-5c15-4965-8ae7-06c43f9f68ac tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:11.872731 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c00bad12-5c15-4965-8ae7-06c43f9f68ac tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:11.873187 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c00bad12-5c15-4965-8ae7-06c43f9f68ac tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:11.873637 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c00bad12-5c15-4965-8ae7-06c43f9f68ac tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:12.028766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-c00bad12-5c15-4965-8ae7-06c43f9f68ac tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:12.037152 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c00bad12-5c15-4965-8ae7-06c43f9f68ac tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.176229 Sep 15 07:48:12.038070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 516/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:11 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:12.518807 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-2b7179cf-d41e-4aed-9429-b280ac6de5f4 req-c7ee4e05-932a-4a35-af38-f3ffba379d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533c974f-14a5-43e3-a746-c3156eae4282", "name": "network-vif-plugged", "status": "completed", "tag": "9499e9bc-c07e-4389-a2e2-415f7d2c8088"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:48:12.530205 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-2b7179cf-d41e-4aed-9429-b280ac6de5f4 req-c7ee4e05-932a-4a35-af38-f3ffba379d41 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:12.530688 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-2b7179cf-d41e-4aed-9429-b280ac6de5f4 req-c7ee4e05-932a-4a35-af38-f3ffba379d41 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:12.531277 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-2b7179cf-d41e-4aed-9429-b280ac6de5f4 req-c7ee4e05-932a-4a35-af38-f3ffba379d41 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:12.533739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=51 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:12.544627 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-2b7179cf-d41e-4aed-9429-b280ac6de5f4 req-c7ee4e05-932a-4a35-af38-f3ffba379d41 service nova] Creating event network-vif-plugged:9499e9bc-c07e-4389-a2e2-415f7d2c8088 for instance 533c974f-14a5-43e3-a746-c3156eae4282 on hv-cinder-82414 Sep 15 07:48:12.550138 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-2b7179cf-d41e-4aed-9429-b280ac6de5f4 req-c7ee4e05-932a-4a35-af38-f3ffba379d41 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035385 Sep 15 07:48:12.550777 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 500/1016] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:48:13.060031 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3d41fc47-686c-4669-a63c-ec4588759409 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:13.060642 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3d41fc47-686c-4669-a63c-ec4588759409 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:13.067329 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d41fc47-686c-4669-a63c-ec4588759409 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:13.067806 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d41fc47-686c-4669-a63c-ec4588759409 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:13.068363 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d41fc47-686c-4669-a63c-ec4588759409 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:13.069116 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d41fc47-686c-4669-a63c-ec4588759409 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:13.069526 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d41fc47-686c-4669-a63c-ec4588759409 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:13.069977 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3d41fc47-686c-4669-a63c-ec4588759409 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:13.197767 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3d41fc47-686c-4669-a63c-ec4588759409 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:13.205280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3d41fc47-686c-4669-a63c-ec4588759409 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.149186 Sep 15 07:48:13.205876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 517/1017] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:13 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:14.230486 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4dd59813-bf0c-4222-b6a8-2cf4cc31af94 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:14.231179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4dd59813-bf0c-4222-b6a8-2cf4cc31af94 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:14.237311 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4dd59813-bf0c-4222-b6a8-2cf4cc31af94 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:14.237830 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4dd59813-bf0c-4222-b6a8-2cf4cc31af94 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:14.240901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4dd59813-bf0c-4222-b6a8-2cf4cc31af94 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:14.240901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4dd59813-bf0c-4222-b6a8-2cf4cc31af94 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:14.240901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4dd59813-bf0c-4222-b6a8-2cf4cc31af94 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:14.240901 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4dd59813-bf0c-4222-b6a8-2cf4cc31af94 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:14.374389 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4dd59813-bf0c-4222-b6a8-2cf4cc31af94 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:14.382811 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4dd59813-bf0c-4222-b6a8-2cf4cc31af94 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1357 microversion: 2.1 time: 0.158221 Sep 15 07:48:14.383409 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 501/1018] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:14 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:15.406270 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b778c7c1-80fc-4a7e-9377-cb7a360315e3 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:15.406888 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b778c7c1-80fc-4a7e-9377-cb7a360315e3 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:15.414078 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b778c7c1-80fc-4a7e-9377-cb7a360315e3 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:15.414590 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b778c7c1-80fc-4a7e-9377-cb7a360315e3 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:15.415026 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b778c7c1-80fc-4a7e-9377-cb7a360315e3 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:15.415719 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b778c7c1-80fc-4a7e-9377-cb7a360315e3 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:15.416176 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b778c7c1-80fc-4a7e-9377-cb7a360315e3 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:15.416604 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b778c7c1-80fc-4a7e-9377-cb7a360315e3 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:15.544505 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-b778c7c1-80fc-4a7e-9377-cb7a360315e3 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:15.552157 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b778c7c1-80fc-4a7e-9377-cb7a360315e3 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1547 microversion: 2.1 time: 0.149758 Sep 15 07:48:15.552731 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 518/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:15 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:15.574095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e05491c4-54c6-4860-a13b-b16755d5f835 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:15.574700 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e05491c4-54c6-4860-a13b-b16755d5f835 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:15.580916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e05491c4-54c6-4860-a13b-b16755d5f835 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:15.581390 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e05491c4-54c6-4860-a13b-b16755d5f835 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:15.581880 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e05491c4-54c6-4860-a13b-b16755d5f835 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:15.582564 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e05491c4-54c6-4860-a13b-b16755d5f835 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:15.583021 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e05491c4-54c6-4860-a13b-b16755d5f835 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:15.583438 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e05491c4-54c6-4860-a13b-b16755d5f835 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:15.713419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e05491c4-54c6-4860-a13b-b16755d5f835 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:15.721348 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e05491c4-54c6-4860-a13b-b16755d5f835 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1547 microversion: 2.1 time: 0.151034 Sep 15 07:48:15.721959 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 502/1020] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:15 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:15.743396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ccbf6497-e099-47ae-aa6d-e1440004e73f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:15.748190 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ccbf6497-e099-47ae-aa6d-e1440004e73f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:15.748962 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ccbf6497-e099-47ae-aa6d-e1440004e73f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Searching by: {'deleted': False, 'project_id': '00091272c5a745f2bf80723a69fbfc61'} {{(pid=132674) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 15 07:48:15.755503 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ccbf6497-e099-47ae-aa6d-e1440004e73f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:15.768120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ccbf6497-e099-47ae-aa6d-e1440004e73f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:15.768120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ccbf6497-e099-47ae-aa6d-e1440004e73f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:15.768120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ccbf6497-e099-47ae-aa6d-e1440004e73f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:15.768120 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ccbf6497-e099-47ae-aa6d-e1440004e73f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:15.768519 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ccbf6497-e099-47ae-aa6d-e1440004e73f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:15.846527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.multi_cell_list [None req-ccbf6497-e099-47ae-aa6d-e1440004e73f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132674) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 15 07:48:15.938287 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ccbf6497-e099-47ae-aa6d-e1440004e73f tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.198600 Sep 15 07:48:15.938793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 519/1021] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Sep 15 07:48:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:48:15.951590 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-62f77d0f-3a28-4da7-b92d-263329c871e5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:15.952210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-62f77d0f-3a28-4da7-b92d-263329c871e5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:15.958319 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-62f77d0f-3a28-4da7-b92d-263329c871e5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:15.958802 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-62f77d0f-3a28-4da7-b92d-263329c871e5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:15.959912 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-62f77d0f-3a28-4da7-b92d-263329c871e5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:15.960631 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-62f77d0f-3a28-4da7-b92d-263329c871e5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:15.961189 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-62f77d0f-3a28-4da7-b92d-263329c871e5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:15.961638 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-62f77d0f-3a28-4da7-b92d-263329c871e5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:16.087625 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-62f77d0f-3a28-4da7-b92d-263329c871e5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:16.095441 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-62f77d0f-3a28-4da7-b92d-263329c871e5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1547 microversion: 2.1 time: 0.147930 Sep 15 07:48:16.096006 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 503/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:15 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:17.007223 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-591d82d0-0789-401f-a513-ca2838a38cfb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:17.007738 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-591d82d0-0789-401f-a513-ca2838a38cfb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:17.014148 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-591d82d0-0789-401f-a513-ca2838a38cfb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:17.014640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-591d82d0-0789-401f-a513-ca2838a38cfb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:17.015087 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-591d82d0-0789-401f-a513-ca2838a38cfb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:17.015781 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-591d82d0-0789-401f-a513-ca2838a38cfb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:17.016274 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-591d82d0-0789-401f-a513-ca2838a38cfb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:17.016708 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-591d82d0-0789-401f-a513-ca2838a38cfb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:17.100725 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-591d82d0-0789-401f-a513-ca2838a38cfb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lazy-loading 'services' on Instance uuid 30ed5535-17bd-48d9-b6b5-ba296066b7ec {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:48:17.279291 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-591d82d0-0789-401f-a513-ca2838a38cfb tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "DELETE /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/os-volume_attachments/000188c6-003e-48ee-baa8-88b8b03a6916" status: 202 len: 0 microversion: 2.1 time: 0.276603 Sep 15 07:48:17.279879 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 520/1023] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:48:17 2022] DELETE /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/os-volume_attachments/000188c6-003e-48ee-baa8-88b8b03a6916 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:48:17.989161 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2b266473-966d-47c7-87a3-00c6a06ee50a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:48:17.991838 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2b266473-966d-47c7-87a3-00c6a06ee50a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:17.998365 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b266473-966d-47c7-87a3-00c6a06ee50a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:17.998875 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b266473-966d-47c7-87a3-00c6a06ee50a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:17.999333 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b266473-966d-47c7-87a3-00c6a06ee50a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:18.000025 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b266473-966d-47c7-87a3-00c6a06ee50a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:18.000477 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b266473-966d-47c7-87a3-00c6a06ee50a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:18.000900 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b266473-966d-47c7-87a3-00c6a06ee50a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:18.404711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fda2ff3d-ac3a-438e-8e7f-b6b2474344c3 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:48:18.411417 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fda2ff3d-ac3a-438e-8e7f-b6b2474344c3 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:18.411923 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fda2ff3d-ac3a-438e-8e7f-b6b2474344c3 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:18.412355 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fda2ff3d-ac3a-438e-8e7f-b6b2474344c3 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:18.434713 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-fda2ff3d-ac3a-438e-8e7f-b6b2474344c3 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Going to try to stop instance {{(pid=132674) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 15 07:48:18.632438 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fda2ff3d-ac3a-438e-8e7f-b6b2474344c3 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "POST /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/action" status: 202 len: 0 microversion: 2.1 time: 0.231752 Sep 15 07:48:18.633259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 521/1024] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:48:18 2022] POST /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 07:48:18.641823 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e471d99a-e4d3-492a-b427-4b526e3f89fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:18.642515 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e471d99a-e4d3-492a-b427-4b526e3f89fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:18.649939 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e471d99a-e4d3-492a-b427-4b526e3f89fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:18.650519 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e471d99a-e4d3-492a-b427-4b526e3f89fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:18.650964 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e471d99a-e4d3-492a-b427-4b526e3f89fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:18.651716 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e471d99a-e4d3-492a-b427-4b526e3f89fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:18.652157 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e471d99a-e4d3-492a-b427-4b526e3f89fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:18.652915 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e471d99a-e4d3-492a-b427-4b526e3f89fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:18.671433 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:18.724102 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2b266473-966d-47c7-87a3-00c6a06ee50a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "POST /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738590 Sep 15 07:48:18.724722 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 504/1025] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:48:17 2022] POST /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments => generated 194 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:48:18.791833 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e471d99a-e4d3-492a-b427-4b526e3f89fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:18.801132 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e471d99a-e4d3-492a-b427-4b526e3f89fe tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1678 microversion: 2.1 time: 0.163224 Sep 15 07:48:18.805916 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 522/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:18 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:48:19.829152 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5e8a9def-5735-40f2-8ced-2ac0298dfb9c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:19.829910 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5e8a9def-5735-40f2-8ced-2ac0298dfb9c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:19.836863 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5e8a9def-5735-40f2-8ced-2ac0298dfb9c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:19.837408 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5e8a9def-5735-40f2-8ced-2ac0298dfb9c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:19.838021 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5e8a9def-5735-40f2-8ced-2ac0298dfb9c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:19.838717 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5e8a9def-5735-40f2-8ced-2ac0298dfb9c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:19.839171 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5e8a9def-5735-40f2-8ced-2ac0298dfb9c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:19.839593 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5e8a9def-5735-40f2-8ced-2ac0298dfb9c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:19.974880 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5e8a9def-5735-40f2-8ced-2ac0298dfb9c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:19.983448 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5e8a9def-5735-40f2-8ced-2ac0298dfb9c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1678 microversion: 2.1 time: 0.158957 Sep 15 07:48:19.984017 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 505/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:19 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:21.006660 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f6e6d975-7f12-4396-8303-1fb79a5ad3d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:21.007246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f6e6d975-7f12-4396-8303-1fb79a5ad3d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:21.014149 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f6e6d975-7f12-4396-8303-1fb79a5ad3d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:21.014626 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f6e6d975-7f12-4396-8303-1fb79a5ad3d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:21.015057 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f6e6d975-7f12-4396-8303-1fb79a5ad3d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:21.015768 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f6e6d975-7f12-4396-8303-1fb79a5ad3d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:21.016232 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f6e6d975-7f12-4396-8303-1fb79a5ad3d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:21.016659 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f6e6d975-7f12-4396-8303-1fb79a5ad3d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:21.142151 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f6e6d975-7f12-4396-8303-1fb79a5ad3d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:21.150452 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f6e6d975-7f12-4396-8303-1fb79a5ad3d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1678 microversion: 2.1 time: 0.148012 Sep 15 07:48:21.151008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 523/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:21 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:22.172579 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c22cc69c-8532-448d-ad7c-0f127a95b369 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:22.173170 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c22cc69c-8532-448d-ad7c-0f127a95b369 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:22.175497 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:22.180482 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c22cc69c-8532-448d-ad7c-0f127a95b369 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:22.180965 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c22cc69c-8532-448d-ad7c-0f127a95b369 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:22.181397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c22cc69c-8532-448d-ad7c-0f127a95b369 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:22.182127 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c22cc69c-8532-448d-ad7c-0f127a95b369 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:22.182578 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c22cc69c-8532-448d-ad7c-0f127a95b369 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:22.183002 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c22cc69c-8532-448d-ad7c-0f127a95b369 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:22.315169 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c22cc69c-8532-448d-ad7c-0f127a95b369 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:22.322870 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c22cc69c-8532-448d-ad7c-0f127a95b369 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1678 microversion: 2.1 time: 0.154286 Sep 15 07:48:22.323425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 506/1029] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:22 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:23.346644 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-939848ab-6cba-47e7-99ea-542562292496 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:23.347251 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-939848ab-6cba-47e7-99ea-542562292496 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:23.349103 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:23.353991 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-939848ab-6cba-47e7-99ea-542562292496 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:23.354472 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-939848ab-6cba-47e7-99ea-542562292496 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:23.354934 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-939848ab-6cba-47e7-99ea-542562292496 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:23.355611 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-939848ab-6cba-47e7-99ea-542562292496 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:23.356054 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-939848ab-6cba-47e7-99ea-542562292496 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:23.356467 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-939848ab-6cba-47e7-99ea-542562292496 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:23.482486 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-939848ab-6cba-47e7-99ea-542562292496 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:23.490320 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-939848ab-6cba-47e7-99ea-542562292496 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1678 microversion: 2.1 time: 0.147565 Sep 15 07:48:23.490830 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 524/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:23 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:24.513886 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-5ce2cbd3-4ae3-44a8-96b1-267af02bb66d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:24.514486 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-5ce2cbd3-4ae3-44a8-96b1-267af02bb66d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:24.520979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ce2cbd3-4ae3-44a8-96b1-267af02bb66d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:24.521465 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ce2cbd3-4ae3-44a8-96b1-267af02bb66d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:24.521936 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ce2cbd3-4ae3-44a8-96b1-267af02bb66d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:24.522749 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ce2cbd3-4ae3-44a8-96b1-267af02bb66d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:24.523210 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ce2cbd3-4ae3-44a8-96b1-267af02bb66d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:24.523639 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-5ce2cbd3-4ae3-44a8-96b1-267af02bb66d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:24.649843 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-5ce2cbd3-4ae3-44a8-96b1-267af02bb66d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:24.657498 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-5ce2cbd3-4ae3-44a8-96b1-267af02bb66d tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1678 microversion: 2.1 time: 0.147581 Sep 15 07:48:24.658094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 507/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:24 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:25.681091 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-0c47cee5-aa85-49b6-82e4-5ff410ddf152 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:25.681735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-0c47cee5-aa85-49b6-82e4-5ff410ddf152 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:25.688487 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0c47cee5-aa85-49b6-82e4-5ff410ddf152 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:25.692355 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0c47cee5-aa85-49b6-82e4-5ff410ddf152 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:25.692355 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0c47cee5-aa85-49b6-82e4-5ff410ddf152 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:25.692355 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0c47cee5-aa85-49b6-82e4-5ff410ddf152 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:25.692355 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0c47cee5-aa85-49b6-82e4-5ff410ddf152 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:25.692762 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-0c47cee5-aa85-49b6-82e4-5ff410ddf152 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:25.788946 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=2 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:25.832167 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-0c47cee5-aa85-49b6-82e4-5ff410ddf152 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:25.841215 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-0c47cee5-aa85-49b6-82e4-5ff410ddf152 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1678 microversion: 2.1 time: 0.164497 Sep 15 07:48:25.841984 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 525/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:25 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:26.335583 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c1549843-8a49-43e7-8ec5-00d497e2d5d9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:26.336193 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c1549843-8a49-43e7-8ec5-00d497e2d5d9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:26.343007 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1549843-8a49-43e7-8ec5-00d497e2d5d9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:26.343522 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1549843-8a49-43e7-8ec5-00d497e2d5d9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:26.344200 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1549843-8a49-43e7-8ec5-00d497e2d5d9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:26.344924 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1549843-8a49-43e7-8ec5-00d497e2d5d9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:26.345387 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1549843-8a49-43e7-8ec5-00d497e2d5d9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:26.345907 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c1549843-8a49-43e7-8ec5-00d497e2d5d9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:26.470476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c1549843-8a49-43e7-8ec5-00d497e2d5d9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:26.479344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c1549843-8a49-43e7-8ec5-00d497e2d5d9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1593 microversion: 2.1 time: 0.148126 Sep 15 07:48:26.479918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 508/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:26 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1593 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:26.865561 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-275bc846-7064-432a-8544-ad07f3690364 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:26.866403 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-275bc846-7064-432a-8544-ad07f3690364 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:26.873214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-275bc846-7064-432a-8544-ad07f3690364 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:26.873744 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-275bc846-7064-432a-8544-ad07f3690364 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:26.874189 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-275bc846-7064-432a-8544-ad07f3690364 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:26.874884 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-275bc846-7064-432a-8544-ad07f3690364 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:26.875344 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-275bc846-7064-432a-8544-ad07f3690364 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:26.875769 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-275bc846-7064-432a-8544-ad07f3690364 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:27.009230 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-275bc846-7064-432a-8544-ad07f3690364 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:27.017156 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-275bc846-7064-432a-8544-ad07f3690364 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1678 microversion: 2.1 time: 0.155482 Sep 15 07:48:27.017744 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 526/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:26 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:28.044756 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e21cbb4b-3434-4ce8-9c72-df1c57771f05 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:28.045357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e21cbb4b-3434-4ce8-9c72-df1c57771f05 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:28.052011 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e21cbb4b-3434-4ce8-9c72-df1c57771f05 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:28.052667 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e21cbb4b-3434-4ce8-9c72-df1c57771f05 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:28.053773 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e21cbb4b-3434-4ce8-9c72-df1c57771f05 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:28.054504 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e21cbb4b-3434-4ce8-9c72-df1c57771f05 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:28.054949 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e21cbb4b-3434-4ce8-9c72-df1c57771f05 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:28.055369 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e21cbb4b-3434-4ce8-9c72-df1c57771f05 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:28.187572 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e21cbb4b-3434-4ce8-9c72-df1c57771f05 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:28.195294 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e21cbb4b-3434-4ce8-9c72-df1c57771f05 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1678 microversion: 2.1 time: 0.154384 Sep 15 07:48:28.195869 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 509/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:28 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:28.545152 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-e4fd9aa1-eb71-462d-8d2e-7dd659faa8f6 req-13aeb05d-fe1d-446f-9781-c7b6b3d302f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533c974f-14a5-43e3-a746-c3156eae4282", "tag": "9499e9bc-c07e-4389-a2e2-415f7d2c8088"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:48:28.556674 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-e4fd9aa1-eb71-462d-8d2e-7dd659faa8f6 req-13aeb05d-fe1d-446f-9781-c7b6b3d302f8 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:28.557312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-e4fd9aa1-eb71-462d-8d2e-7dd659faa8f6 req-13aeb05d-fe1d-446f-9781-c7b6b3d302f8 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:28.557776 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-e4fd9aa1-eb71-462d-8d2e-7dd659faa8f6 req-13aeb05d-fe1d-446f-9781-c7b6b3d302f8 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:28.569287 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-e4fd9aa1-eb71-462d-8d2e-7dd659faa8f6 req-13aeb05d-fe1d-446f-9781-c7b6b3d302f8 service nova] Creating event network-changed:9499e9bc-c07e-4389-a2e2-415f7d2c8088 for instance 533c974f-14a5-43e3-a746-c3156eae4282 on hv-cinder-82414 Sep 15 07:48:28.574753 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-e4fd9aa1-eb71-462d-8d2e-7dd659faa8f6 req-13aeb05d-fe1d-446f-9781-c7b6b3d302f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033170 Sep 15 07:48:28.575341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 527/1036] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:48:29.219920 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-c2246f90-a3de-4729-a3eb-71e1e89d8cd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:29.220532 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-c2246f90-a3de-4729-a3eb-71e1e89d8cd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:29.227423 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c2246f90-a3de-4729-a3eb-71e1e89d8cd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:29.227974 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c2246f90-a3de-4729-a3eb-71e1e89d8cd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:29.228408 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c2246f90-a3de-4729-a3eb-71e1e89d8cd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:29.229140 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c2246f90-a3de-4729-a3eb-71e1e89d8cd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:29.229602 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c2246f90-a3de-4729-a3eb-71e1e89d8cd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:29.230042 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-c2246f90-a3de-4729-a3eb-71e1e89d8cd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:29.410554 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-c2246f90-a3de-4729-a3eb-71e1e89d8cd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:29.419218 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-c2246f90-a3de-4729-a3eb-71e1e89d8cd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1655 microversion: 2.1 time: 0.203453 Sep 15 07:48:29.425397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 510/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:29 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1655 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:29.442683 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-aa587237-2f40-4812-bc03-83520fc957ef tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:48:29.450193 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aa587237-2f40-4812-bc03-83520fc957ef tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:29.450915 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aa587237-2f40-4812-bc03-83520fc957ef tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:29.451353 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aa587237-2f40-4812-bc03-83520fc957ef tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:29.475437 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-aa587237-2f40-4812-bc03-83520fc957ef tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Going to try to start instance {{(pid=132674) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 15 07:48:29.665791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-aa587237-2f40-4812-bc03-83520fc957ef tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "POST /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/action" status: 202 len: 0 microversion: 2.1 time: 0.226993 Sep 15 07:48:29.666824 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 528/1038] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:48:29 2022] POST /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:48:29.674420 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e720a7f9-1a2e-4cac-af07-6543cb359b61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:29.682202 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e720a7f9-1a2e-4cac-af07-6543cb359b61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:29.688576 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e720a7f9-1a2e-4cac-af07-6543cb359b61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:29.689137 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e720a7f9-1a2e-4cac-af07-6543cb359b61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:29.689599 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e720a7f9-1a2e-4cac-af07-6543cb359b61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:29.690300 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e720a7f9-1a2e-4cac-af07-6543cb359b61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:29.690754 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e720a7f9-1a2e-4cac-af07-6543cb359b61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:29.691178 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e720a7f9-1a2e-4cac-af07-6543cb359b61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:29.844572 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e720a7f9-1a2e-4cac-af07-6543cb359b61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:29.854116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e720a7f9-1a2e-4cac-af07-6543cb359b61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1664 microversion: 2.1 time: 0.183374 Sep 15 07:48:29.854745 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 511/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:29 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1664 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:30.878533 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-50b9b28f-ac02-4a8a-8bb8-fb8195970788 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:30.879236 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-50b9b28f-ac02-4a8a-8bb8-fb8195970788 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:30.886975 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-50b9b28f-ac02-4a8a-8bb8-fb8195970788 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:30.887472 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-50b9b28f-ac02-4a8a-8bb8-fb8195970788 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:30.887913 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-50b9b28f-ac02-4a8a-8bb8-fb8195970788 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:30.888610 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-50b9b28f-ac02-4a8a-8bb8-fb8195970788 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:30.889305 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-50b9b28f-ac02-4a8a-8bb8-fb8195970788 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:30.889895 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-50b9b28f-ac02-4a8a-8bb8-fb8195970788 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:31.036673 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-50b9b28f-ac02-4a8a-8bb8-fb8195970788 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:31.044560 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-50b9b28f-ac02-4a8a-8bb8-fb8195970788 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1664 microversion: 2.1 time: 0.171039 Sep 15 07:48:31.045137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 529/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:30 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1664 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:31.263308 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-91184017-e116-4f1e-a5fe-29dcaf9a1ce8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1905868263"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:48:31.263848 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-91184017-e116-4f1e-a5fe-29dcaf9a1ce8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:31.270258 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91184017-e116-4f1e-a5fe-29dcaf9a1ce8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:31.270728 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91184017-e116-4f1e-a5fe-29dcaf9a1ce8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:31.275105 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91184017-e116-4f1e-a5fe-29dcaf9a1ce8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:31.275105 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91184017-e116-4f1e-a5fe-29dcaf9a1ce8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:31.275105 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91184017-e116-4f1e-a5fe-29dcaf9a1ce8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:31.275105 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-91184017-e116-4f1e-a5fe-29dcaf9a1ce8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:31.397974 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.network.security_group_api [None req-91184017-e116-4f1e-a5fe-29dcaf9a1ce8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Adding security group 408b2aa9-b550-4c7d-a697-0e509d9d3a37 to port 9499e9bc-c07e-4389-a2e2-415f7d2c8088 Sep 15 07:48:31.806493 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-91184017-e116-4f1e-a5fe-29dcaf9a1ce8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "POST /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/action" status: 202 len: 0 microversion: 2.1 time: 0.547069 Sep 15 07:48:31.807107 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 512/1041] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:48:31 2022] POST /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:48:31.815498 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-75b1039e-9348-4740-985c-b2342f9ba731 req-b7b4b858-9b9a-4a4e-a379-a3424c3dca50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533c974f-14a5-43e3-a746-c3156eae4282", "tag": "9499e9bc-c07e-4389-a2e2-415f7d2c8088"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:48:31.826243 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b530ba5d-a620-4046-8607-de6e3b892074 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:31.826864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b530ba5d-a620-4046-8607-de6e3b892074 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:31.835494 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-75b1039e-9348-4740-985c-b2342f9ba731 req-b7b4b858-9b9a-4a4e-a379-a3424c3dca50 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:31.835986 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-75b1039e-9348-4740-985c-b2342f9ba731 req-b7b4b858-9b9a-4a4e-a379-a3424c3dca50 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:31.836422 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-75b1039e-9348-4740-985c-b2342f9ba731 req-b7b4b858-9b9a-4a4e-a379-a3424c3dca50 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:31.841864 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b530ba5d-a620-4046-8607-de6e3b892074 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:31.842357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b530ba5d-a620-4046-8607-de6e3b892074 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:31.842799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b530ba5d-a620-4046-8607-de6e3b892074 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:31.843504 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b530ba5d-a620-4046-8607-de6e3b892074 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:31.843966 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b530ba5d-a620-4046-8607-de6e3b892074 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:31.844393 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b530ba5d-a620-4046-8607-de6e3b892074 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:31.867187 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-75b1039e-9348-4740-985c-b2342f9ba731 req-b7b4b858-9b9a-4a4e-a379-a3424c3dca50 service nova] Creating event network-changed:9499e9bc-c07e-4389-a2e2-415f7d2c8088 for instance 533c974f-14a5-43e3-a746-c3156eae4282 on hv-cinder-82414 Sep 15 07:48:31.872267 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-75b1039e-9348-4740-985c-b2342f9ba731 req-b7b4b858-9b9a-4a4e-a379-a3424c3dca50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060988 Sep 15 07:48:31.872890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 530/1042] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:48:32.070508 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-89b5afa1-03f4-4df8-8a58-5d85c908125a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:32.071213 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-89b5afa1-03f4-4df8-8a58-5d85c908125a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:32.077901 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b5afa1-03f4-4df8-8a58-5d85c908125a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:32.078753 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b5afa1-03f4-4df8-8a58-5d85c908125a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:32.079433 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b5afa1-03f4-4df8-8a58-5d85c908125a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:32.080319 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b5afa1-03f4-4df8-8a58-5d85c908125a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:32.080845 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b5afa1-03f4-4df8-8a58-5d85c908125a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:32.081448 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-89b5afa1-03f4-4df8-8a58-5d85c908125a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:32.095425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b530ba5d-a620-4046-8607-de6e3b892074 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:32.106075 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b530ba5d-a620-4046-8607-de6e3b892074 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1758 microversion: 2.1 time: 0.289458 Sep 15 07:48:32.106946 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 513/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:31 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1758 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:32.311114 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-89b5afa1-03f4-4df8-8a58-5d85c908125a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:32.321048 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-89b5afa1-03f4-4df8-8a58-5d85c908125a tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1668 microversion: 2.1 time: 0.256330 Sep 15 07:48:32.321799 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 531/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:32 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1668 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:49.170529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6d725f73-8d60-4089-a3d4-7302d02143b8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:48:49.172913 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6d725f73-8d60-4089-a3d4-7302d02143b8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:49.175452 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=15 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:49.176131 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:49.181495 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d725f73-8d60-4089-a3d4-7302d02143b8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:49.182044 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d725f73-8d60-4089-a3d4-7302d02143b8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:49.182560 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d725f73-8d60-4089-a3d4-7302d02143b8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:49.183315 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d725f73-8d60-4089-a3d4-7302d02143b8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:49.183781 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d725f73-8d60-4089-a3d4-7302d02143b8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:49.184200 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6d725f73-8d60-4089-a3d4-7302d02143b8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:49.460681 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6d725f73-8d60-4089-a3d4-7302d02143b8 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "POST /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/action" status: 202 len: 0 microversion: 2.1 time: 0.294711 Sep 15 07:48:49.464399 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 514/1045] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:48:49 2022] POST /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 07:48:49.471663 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6fffee89-99d4-41d4-8526-6e57a0dadb97 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:49.472351 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-6fffee89-99d4-41d4-8526-6e57a0dadb97 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:49.475205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=15 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:49.475861 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:48:49.480704 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fffee89-99d4-41d4-8526-6e57a0dadb97 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:49.484264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fffee89-99d4-41d4-8526-6e57a0dadb97 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:49.484264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fffee89-99d4-41d4-8526-6e57a0dadb97 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:49.484264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fffee89-99d4-41d4-8526-6e57a0dadb97 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:49.484264 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fffee89-99d4-41d4-8526-6e57a0dadb97 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:49.484667 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-6fffee89-99d4-41d4-8526-6e57a0dadb97 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:49.786926 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-6fffee89-99d4-41d4-8526-6e57a0dadb97 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:49.795913 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6fffee89-99d4-41d4-8526-6e57a0dadb97 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1750 microversion: 2.1 time: 0.328364 Sep 15 07:48:49.796572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 532/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:49 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1750 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:50.821509 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-65ce8eb5-a06c-431c-bd99-18ed3de651a1 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:50.822246 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-65ce8eb5-a06c-431c-bd99-18ed3de651a1 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:50.830054 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-65ce8eb5-a06c-431c-bd99-18ed3de651a1 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:50.830530 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-65ce8eb5-a06c-431c-bd99-18ed3de651a1 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:50.830968 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-65ce8eb5-a06c-431c-bd99-18ed3de651a1 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:50.831662 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-65ce8eb5-a06c-431c-bd99-18ed3de651a1 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:50.832123 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-65ce8eb5-a06c-431c-bd99-18ed3de651a1 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:50.832918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-65ce8eb5-a06c-431c-bd99-18ed3de651a1 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:51.127196 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-65ce8eb5-a06c-431c-bd99-18ed3de651a1 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:51.136243 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-65ce8eb5-a06c-431c-bd99-18ed3de651a1 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1755 microversion: 2.1 time: 0.319679 Sep 15 07:48:51.136923 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 515/1047] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:50 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1755 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:52.159345 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-7bd5bfe1-aa32-4011-8336-a4ffcabb6b83 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:52.160043 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-7bd5bfe1-aa32-4011-8336-a4ffcabb6b83 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:52.166884 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7bd5bfe1-aa32-4011-8336-a4ffcabb6b83 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:52.167357 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7bd5bfe1-aa32-4011-8336-a4ffcabb6b83 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:52.167784 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7bd5bfe1-aa32-4011-8336-a4ffcabb6b83 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:52.168466 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7bd5bfe1-aa32-4011-8336-a4ffcabb6b83 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:52.168916 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7bd5bfe1-aa32-4011-8336-a4ffcabb6b83 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:52.169333 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-7bd5bfe1-aa32-4011-8336-a4ffcabb6b83 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:52.319880 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-7bd5bfe1-aa32-4011-8336-a4ffcabb6b83 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:52.328879 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-7bd5bfe1-aa32-4011-8336-a4ffcabb6b83 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1755 microversion: 2.1 time: 0.173364 Sep 15 07:48:52.329440 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 533/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:52 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:53.352237 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-a4693abb-914a-4d69-9ee9-4ec31e1a9c5e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:53.352845 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-a4693abb-914a-4d69-9ee9-4ec31e1a9c5e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:53.359865 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a4693abb-914a-4d69-9ee9-4ec31e1a9c5e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:53.360342 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a4693abb-914a-4d69-9ee9-4ec31e1a9c5e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:53.360773 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a4693abb-914a-4d69-9ee9-4ec31e1a9c5e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:53.361454 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a4693abb-914a-4d69-9ee9-4ec31e1a9c5e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:53.361940 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a4693abb-914a-4d69-9ee9-4ec31e1a9c5e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:53.362360 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-a4693abb-914a-4d69-9ee9-4ec31e1a9c5e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:53.503967 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-a4693abb-914a-4d69-9ee9-4ec31e1a9c5e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:53.513453 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-a4693abb-914a-4d69-9ee9-4ec31e1a9c5e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1755 microversion: 2.1 time: 0.165073 Sep 15 07:48:53.514049 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 516/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:53 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:48:54.536482 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f7bd6285-9b56-4bdd-b352-11ece2a01306 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:54.537098 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f7bd6285-9b56-4bdd-b352-11ece2a01306 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:54.543914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f7bd6285-9b56-4bdd-b352-11ece2a01306 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:54.544403 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f7bd6285-9b56-4bdd-b352-11ece2a01306 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:54.544841 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f7bd6285-9b56-4bdd-b352-11ece2a01306 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:54.545534 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f7bd6285-9b56-4bdd-b352-11ece2a01306 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:54.546014 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f7bd6285-9b56-4bdd-b352-11ece2a01306 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:54.546443 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f7bd6285-9b56-4bdd-b352-11ece2a01306 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:54.689181 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f7bd6285-9b56-4bdd-b352-11ece2a01306 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:54.698005 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f7bd6285-9b56-4bdd-b352-11ece2a01306 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1755 microversion: 2.1 time: 0.164749 Sep 15 07:48:54.698580 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 534/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:54 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:55.721408 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-2b08ae86-80b7-4740-8855-a9c34a922afb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:55.722047 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-2b08ae86-80b7-4740-8855-a9c34a922afb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:55.728970 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b08ae86-80b7-4740-8855-a9c34a922afb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:55.729749 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b08ae86-80b7-4740-8855-a9c34a922afb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:55.730192 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b08ae86-80b7-4740-8855-a9c34a922afb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:55.731688 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b08ae86-80b7-4740-8855-a9c34a922afb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:55.731688 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b08ae86-80b7-4740-8855-a9c34a922afb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:55.731902 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-2b08ae86-80b7-4740-8855-a9c34a922afb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:55.880661 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-2b08ae86-80b7-4740-8855-a9c34a922afb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:55.889325 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-2b08ae86-80b7-4740-8855-a9c34a922afb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1755 microversion: 2.1 time: 0.171824 Sep 15 07:48:55.889918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 517/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:55 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:56.912374 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fcf16fa3-c707-4463-9688-d2a9d35570a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:56.912902 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-fcf16fa3-c707-4463-9688-d2a9d35570a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:56.919415 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fcf16fa3-c707-4463-9688-d2a9d35570a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:56.919933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fcf16fa3-c707-4463-9688-d2a9d35570a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:56.920530 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fcf16fa3-c707-4463-9688-d2a9d35570a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:56.921213 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fcf16fa3-c707-4463-9688-d2a9d35570a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:56.921691 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fcf16fa3-c707-4463-9688-d2a9d35570a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:56.922110 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fcf16fa3-c707-4463-9688-d2a9d35570a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:57.065639 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-fcf16fa3-c707-4463-9688-d2a9d35570a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:57.073985 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fcf16fa3-c707-4463-9688-d2a9d35570a2 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1755 microversion: 2.1 time: 0.165579 Sep 15 07:48:57.074572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 535/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:56 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:58.097059 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-16788e6c-7a04-401f-8ea1-214e6aa66e8e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:58.097671 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-16788e6c-7a04-401f-8ea1-214e6aa66e8e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:58.104057 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16788e6c-7a04-401f-8ea1-214e6aa66e8e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:58.104530 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16788e6c-7a04-401f-8ea1-214e6aa66e8e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:58.104955 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16788e6c-7a04-401f-8ea1-214e6aa66e8e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:58.105663 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16788e6c-7a04-401f-8ea1-214e6aa66e8e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:58.106111 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16788e6c-7a04-401f-8ea1-214e6aa66e8e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:58.106529 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-16788e6c-7a04-401f-8ea1-214e6aa66e8e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:58.250128 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-16788e6c-7a04-401f-8ea1-214e6aa66e8e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:58.258319 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-16788e6c-7a04-401f-8ea1-214e6aa66e8e tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1755 microversion: 2.1 time: 0.165095 Sep 15 07:48:58.258886 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 518/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:58 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:48:59.282268 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a069cb91-b45e-47b5-991d-ea82cbb55e28 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:48:59.282832 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a069cb91-b45e-47b5-991d-ea82cbb55e28 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:48:59.289159 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a069cb91-b45e-47b5-991d-ea82cbb55e28 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:59.289674 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a069cb91-b45e-47b5-991d-ea82cbb55e28 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:59.290110 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a069cb91-b45e-47b5-991d-ea82cbb55e28 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:59.290812 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a069cb91-b45e-47b5-991d-ea82cbb55e28 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:48:59.291250 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a069cb91-b45e-47b5-991d-ea82cbb55e28 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:48:59.291668 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a069cb91-b45e-47b5-991d-ea82cbb55e28 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:48:59.438866 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-a069cb91-b45e-47b5-991d-ea82cbb55e28 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:48:59.447770 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a069cb91-b45e-47b5-991d-ea82cbb55e28 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1755 microversion: 2.1 time: 0.169493 Sep 15 07:48:59.448577 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 536/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:48:59 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:00.471550 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-4395824e-d175-4a9e-bc21-2b03bc9b5bc0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:00.472167 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-4395824e-d175-4a9e-bc21-2b03bc9b5bc0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:00.478595 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4395824e-d175-4a9e-bc21-2b03bc9b5bc0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:00.479080 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4395824e-d175-4a9e-bc21-2b03bc9b5bc0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:00.479521 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4395824e-d175-4a9e-bc21-2b03bc9b5bc0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:00.480209 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4395824e-d175-4a9e-bc21-2b03bc9b5bc0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:00.480667 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4395824e-d175-4a9e-bc21-2b03bc9b5bc0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:00.481093 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-4395824e-d175-4a9e-bc21-2b03bc9b5bc0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:00.622402 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-4395824e-d175-4a9e-bc21-2b03bc9b5bc0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:00.630561 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-4395824e-d175-4a9e-bc21-2b03bc9b5bc0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1755 microversion: 2.1 time: 0.162920 Sep 15 07:49:00.631128 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 519/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:00 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:01.654880 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-21d7119d-981c-49b3-ab83-7e9f5095b896 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:01.655489 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-21d7119d-981c-49b3-ab83-7e9f5095b896 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:01.662128 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21d7119d-981c-49b3-ab83-7e9f5095b896 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:01.662606 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21d7119d-981c-49b3-ab83-7e9f5095b896 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:01.663038 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21d7119d-981c-49b3-ab83-7e9f5095b896 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:01.663902 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21d7119d-981c-49b3-ab83-7e9f5095b896 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:01.664357 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21d7119d-981c-49b3-ab83-7e9f5095b896 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:01.664794 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-21d7119d-981c-49b3-ab83-7e9f5095b896 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:01.811688 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-21d7119d-981c-49b3-ab83-7e9f5095b896 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:01.819892 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-21d7119d-981c-49b3-ab83-7e9f5095b896 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1758 microversion: 2.1 time: 0.168966 Sep 15 07:49:01.820456 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 537/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:01 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:04.890876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b1e92f84-941a-4b17-ba8b-a007114e9618 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:04.893039 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b1e92f84-941a-4b17-ba8b-a007114e9618 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:04.899828 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1e92f84-941a-4b17-ba8b-a007114e9618 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:04.900504 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1e92f84-941a-4b17-ba8b-a007114e9618 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:04.900942 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1e92f84-941a-4b17-ba8b-a007114e9618 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:04.901672 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1e92f84-941a-4b17-ba8b-a007114e9618 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:04.902133 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1e92f84-941a-4b17-ba8b-a007114e9618 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:04.902557 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b1e92f84-941a-4b17-ba8b-a007114e9618 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:04.932477 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b1e92f84-941a-4b17-ba8b-a007114e9618 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045500 Sep 15 07:49:04.933062 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 520/1057] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:49:04 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 07:49:04.996802 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-946587b9-16a0-480e-9b5a-4bf436768b21 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:04.997340 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-946587b9-16a0-480e-9b5a-4bf436768b21 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:05.004294 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-946587b9-16a0-480e-9b5a-4bf436768b21 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:05.004765 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-946587b9-16a0-480e-9b5a-4bf436768b21 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:05.005225 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-946587b9-16a0-480e-9b5a-4bf436768b21 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:05.005946 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-946587b9-16a0-480e-9b5a-4bf436768b21 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:05.006396 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-946587b9-16a0-480e-9b5a-4bf436768b21 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:05.006815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-946587b9-16a0-480e-9b5a-4bf436768b21 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:05.032116 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-946587b9-16a0-480e-9b5a-4bf436768b21 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:49:05.321382 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-946587b9-16a0-480e-9b5a-4bf436768b21 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "DELETE /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 204 len: 0 microversion: 2.1 time: 0.328480 Sep 15 07:49:05.322087 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 538/1058] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:49:04 2022] DELETE /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:49:05.330145 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-348810b7-96de-4cce-9804-3aec84d5b6ce tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:05.334020 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-348810b7-96de-4cce-9804-3aec84d5b6ce tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:05.336738 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-348810b7-96de-4cce-9804-3aec84d5b6ce tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:05.337202 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-348810b7-96de-4cce-9804-3aec84d5b6ce tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:05.337657 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-348810b7-96de-4cce-9804-3aec84d5b6ce tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:05.338695 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-348810b7-96de-4cce-9804-3aec84d5b6ce tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:05.339066 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-348810b7-96de-4cce-9804-3aec84d5b6ce tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:05.339487 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-348810b7-96de-4cce-9804-3aec84d5b6ce tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:05.468569 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-348810b7-96de-4cce-9804-3aec84d5b6ce tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:05.476220 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-348810b7-96de-4cce-9804-3aec84d5b6ce tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1674 microversion: 2.1 time: 0.149840 Sep 15 07:49:05.476788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 521/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:05 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:06.500338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-682ccef6-6ed7-4de2-a928-1eb1de146229 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:06.501071 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-682ccef6-6ed7-4de2-a928-1eb1de146229 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:06.507440 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-682ccef6-6ed7-4de2-a928-1eb1de146229 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:06.507921 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-682ccef6-6ed7-4de2-a928-1eb1de146229 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:06.508358 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-682ccef6-6ed7-4de2-a928-1eb1de146229 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:06.509737 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-682ccef6-6ed7-4de2-a928-1eb1de146229 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:06.510195 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-682ccef6-6ed7-4de2-a928-1eb1de146229 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:06.510623 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-682ccef6-6ed7-4de2-a928-1eb1de146229 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:06.638249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-682ccef6-6ed7-4de2-a928-1eb1de146229 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:06.645933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-682ccef6-6ed7-4de2-a928-1eb1de146229 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1674 microversion: 2.1 time: 0.149796 Sep 15 07:49:06.646497 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 539/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:06 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:07.674603 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b80c8a14-c302-4b49-8bae-00519d31fe61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:07.675227 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-b80c8a14-c302-4b49-8bae-00519d31fe61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:07.686635 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b80c8a14-c302-4b49-8bae-00519d31fe61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:07.687124 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b80c8a14-c302-4b49-8bae-00519d31fe61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:07.687559 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b80c8a14-c302-4b49-8bae-00519d31fe61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:07.688254 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b80c8a14-c302-4b49-8bae-00519d31fe61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:07.688707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b80c8a14-c302-4b49-8bae-00519d31fe61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:07.689123 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-b80c8a14-c302-4b49-8bae-00519d31fe61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:07.885888 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-b80c8a14-c302-4b49-8bae-00519d31fe61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:07.893468 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b80c8a14-c302-4b49-8bae-00519d31fe61 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1674 microversion: 2.1 time: 0.226703 Sep 15 07:49:07.899673 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 522/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:07 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1674 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:08.342321 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-689712a4-e68f-4874-b414-d920e034207c req-2b1efbb0-8194-4516-9a77-63ef4a90d7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30ed5535-17bd-48d9-b6b5-ba296066b7ec", "name": "network-vif-deleted", "tag": "6e5a7191-bf35-416a-9367-9584add6f1b5"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:08.351797 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-689712a4-e68f-4874-b414-d920e034207c req-2b1efbb0-8194-4516-9a77-63ef4a90d7df service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:08.352338 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-689712a4-e68f-4874-b414-d920e034207c req-2b1efbb0-8194-4516-9a77-63ef4a90d7df service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:08.352767 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-689712a4-e68f-4874-b414-d920e034207c req-2b1efbb0-8194-4516-9a77-63ef4a90d7df service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:08.364605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-689712a4-e68f-4874-b414-d920e034207c req-2b1efbb0-8194-4516-9a77-63ef4a90d7df service nova] Creating event network-vif-deleted:6e5a7191-bf35-416a-9367-9584add6f1b5 for instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec on hv-cinder-82414 Sep 15 07:49:08.369904 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-689712a4-e68f-4874-b414-d920e034207c req-2b1efbb0-8194-4516-9a77-63ef4a90d7df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091708 Sep 15 07:49:08.373952 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 540/1062] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:08.918037 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:08.918643 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:08.925264 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:08.925797 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:08.926237 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:08.926949 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:08.927403 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:08.927828 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:08.960848 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:08.961334 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:08.962397 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:08.963090 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.objects.instance [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lazy-loading 'fault' on Instance uuid 30ed5535-17bd-48d9-b6b5-ba296066b7ec {{(pid=132673) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:49:09.006574 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:09.015023 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-0239d125-4e97-4ec6-859e-49ecfd10a493 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 200 len: 1326 microversion: 2.1 time: 0.100989 Sep 15 07:49:09.015589 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 523/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:08 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:10.039018 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:10.040136 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:10.046271 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:10.046759 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:10.047198 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:10.047890 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:10.048346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:10.048773 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:10.062612 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] HTTP exception thrown: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Request method failure captured: Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec HTTP/1.1 Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItg8dqvWN2t91HpO2f1YgToZu8w4RXinF2BJUSaUxJDZILTvoIqWwrZAuG81WEJZdbQvkfFMGoH7t_M8zwldYxG_Y6kGvGJ6nxMgqfPPRxnS76wTvF17OM-NA7cc5Bdk_BXPdXeuDTxw3fpdKmqB0e464twrvADIGpxET9k0DWHkyyg Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:49:10.064201 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a9d0f5e6d6cf423485157e1381a12713"}]}] Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: f8022d5f904e4ae294b2cdf21aa11212 Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:49:10.065918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '30ed5535-17bd-48d9-b6b5-ba296066b7ec'} Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:49:10.066914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:49:10.068565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:10.070329 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Returning 404 to user: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:49:10.070329 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-35c6c857-3c71-4ada-baca-f548921ad164 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 404 len: 111 microversion: 2.1 time: 0.031382 Sep 15 07:49:10.070329 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 541/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:10 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:49:10.075286 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-bc240744-4a72-4258-a057-1fe2ca862434 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '.version_select at 0x7ff36c7eb4c0>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:10.178514 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-bc240744-4a72-4258-a057-1fe2ca862434 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-148655227" status: 202 len: 0 microversion: 2.1 time: 0.107968 Sep 15 07:49:10.179088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 524/1065] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Sep 15 07:49:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-148655227 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:49:10.973602 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ccc52997-a9ff-419c-ad18-73747adb8976 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Action: 'create', calling method: .version_select at 0x7ff36d4e2790>, body: {"keypair": {"name": "tempest-keypair-2021748343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwttewYt3HjnpGYzhGMBF7K6uKaLs8RIfRcoVwNRr8xOreWVNr9MWrzvw2YV/M/JIrQ30hoFjGoyDrQRDX8OWJeSmMdoI5qDARUYJ+qkHgE5ptjdgVyYK93iqvbckw88w=="}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:10.989275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-ccc52997-a9ff-419c-ad18-73747adb8976 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Getting quotas for project a9d0f5e6d6cf423485157e1381a12713. Resources: {'key_pairs'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:49:10.993093 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.quota [None req-ccc52997-a9ff-419c-ad18-73747adb8976 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Getting quotas for user f8022d5f904e4ae294b2cdf21aa11212 and project a9d0f5e6d6cf423485157e1381a12713. Resources: {'key_pairs'} {{(pid=132674) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:49:11.069723 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ccc52997-a9ff-419c-ad18-73747adb8976 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099975 Sep 15 07:49:11.070373 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 542/1066] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 15 07:49:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:13.442083 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1250353977", "imageRef": "d4ada2ed-c34e-4994-a405-a7490208f8ad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a516fb80-088a-420e-bbe2-327bfb75896d"}], "security_groups": [{"name": "tempest-securitygroup--493321705"}], "key_name": "tempest-keypair-2021748343", "user_data": "}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:13.547298 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.network.neutron [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] validate_networks() for [('a516fb80-088a-420e-bbe2-327bfb75896d', None, None, None, None, None)] {{(pid=132673) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 15 07:49:13.918430 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Flavor limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 07:49:13.918848 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Image limits 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 07:49:13.919313 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Flavor pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 07:49:13.919713 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Image pref 0:0:0 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 07:49:13.920116 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.virt.hardware [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132673) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 07:49:13.928715 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:13.929187 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:13.929651 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:13.930950 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:13.931396 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:13.931817 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:13.948894 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Getting quotas for project a9d0f5e6d6cf423485157e1381a12713. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 15 07:49:13.952878 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.quota [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Getting quotas for user f8022d5f904e4ae294b2cdf21aa11212 and project a9d0f5e6d6cf423485157e1381a12713. Resources: {'instances', 'ram', 'cores'} {{(pid=132673) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 15 07:49:13.964620 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Going to run 1 instances... {{(pid=132673) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 15 07:49:13.966925 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4ada2ed-c34e-4994-a405-a7490208f8ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132673) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 15 07:49:14.103099 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e4c756b7-1139-43c4-bf58-f9d13a166c7f tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.666313 Sep 15 07:49:14.103680 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 525/1067] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 15 07:49:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 07:49:14.115439 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e0674c12-03ca-4543-9e99-64dd9d0decd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:14.116105 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e0674c12-03ca-4543-9e99-64dd9d0decd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:14.173866 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-e0674c12-03ca-4543-9e99-64dd9d0decd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:14.181340 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e0674c12-03ca-4543-9e99-64dd9d0decd9 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1238 microversion: 2.1 time: 0.070387 Sep 15 07:49:14.181937 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 543/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:14 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:15.204151 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-7df3d5c2-e9f6-4296-a7ed-ea080565e6be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:15.204740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-7df3d5c2-e9f6-4296-a7ed-ea080565e6be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:15.212219 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7df3d5c2-e9f6-4296-a7ed-ea080565e6be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:15.212979 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7df3d5c2-e9f6-4296-a7ed-ea080565e6be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:15.213414 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7df3d5c2-e9f6-4296-a7ed-ea080565e6be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:15.214136 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7df3d5c2-e9f6-4296-a7ed-ea080565e6be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:15.214643 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7df3d5c2-e9f6-4296-a7ed-ea080565e6be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:15.215063 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-7df3d5c2-e9f6-4296-a7ed-ea080565e6be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:15.278889 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-7df3d5c2-e9f6-4296-a7ed-ea080565e6be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:15.286644 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-7df3d5c2-e9f6-4296-a7ed-ea080565e6be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1242 microversion: 2.1 time: 0.086676 Sep 15 07:49:15.287201 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 526/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:15 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:16.309695 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-ff839c02-7299-4e23-8dd4-37385ca050f4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:16.310313 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-ff839c02-7299-4e23-8dd4-37385ca050f4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:16.317178 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ff839c02-7299-4e23-8dd4-37385ca050f4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:16.317987 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ff839c02-7299-4e23-8dd4-37385ca050f4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:16.318433 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ff839c02-7299-4e23-8dd4-37385ca050f4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:16.319147 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ff839c02-7299-4e23-8dd4-37385ca050f4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:16.319615 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ff839c02-7299-4e23-8dd4-37385ca050f4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:16.320045 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-ff839c02-7299-4e23-8dd4-37385ca050f4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:16.397892 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-ff839c02-7299-4e23-8dd4-37385ca050f4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:16.406189 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-ff839c02-7299-4e23-8dd4-37385ca050f4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1298 microversion: 2.1 time: 0.100515 Sep 15 07:49:16.407095 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 544/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:16 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:17.433114 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-83f9d35a-0a7e-44a6-b207-36bbf95c1b37 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:17.433678 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-83f9d35a-0a7e-44a6-b207-36bbf95c1b37 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:17.440605 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-83f9d35a-0a7e-44a6-b207-36bbf95c1b37 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:17.441095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-83f9d35a-0a7e-44a6-b207-36bbf95c1b37 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:17.441533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-83f9d35a-0a7e-44a6-b207-36bbf95c1b37 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:17.442248 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-83f9d35a-0a7e-44a6-b207-36bbf95c1b37 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:17.442756 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-83f9d35a-0a7e-44a6-b207-36bbf95c1b37 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:17.443179 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-83f9d35a-0a7e-44a6-b207-36bbf95c1b37 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:17.867870 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-83f9d35a-0a7e-44a6-b207-36bbf95c1b37 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:17.875602 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-83f9d35a-0a7e-44a6-b207-36bbf95c1b37 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1363 microversion: 2.1 time: 0.447300 Sep 15 07:49:17.879983 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 527/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:17 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:18.302132 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-71576548-7018-4853-93ec-8e659009268d req-dd1c3a86-16d6-4451-a49f-dd98174898fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd", "tag": "a9942a95-f13c-4b93-b3ea-9e337fbfb77e"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:18.312334 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-71576548-7018-4853-93ec-8e659009268d req-dd1c3a86-16d6-4451-a49f-dd98174898fc service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:18.312808 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-71576548-7018-4853-93ec-8e659009268d req-dd1c3a86-16d6-4451-a49f-dd98174898fc service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:18.313235 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-71576548-7018-4853-93ec-8e659009268d req-dd1c3a86-16d6-4451-a49f-dd98174898fc service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:18.324412 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-71576548-7018-4853-93ec-8e659009268d req-dd1c3a86-16d6-4451-a49f-dd98174898fc service nova] Creating event network-changed:a9942a95-f13c-4b93-b3ea-9e337fbfb77e for instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd on hv-cinder-82414 Sep 15 07:49:18.329710 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-71576548-7018-4853-93ec-8e659009268d req-dd1c3a86-16d6-4451-a49f-dd98174898fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031641 Sep 15 07:49:18.330797 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 545/1072] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:18.900502 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-42719a74-2dd1-48f5-a80f-a6129778c1aa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:18.901236 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-42719a74-2dd1-48f5-a80f-a6129778c1aa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:18.907632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-42719a74-2dd1-48f5-a80f-a6129778c1aa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:18.908110 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-42719a74-2dd1-48f5-a80f-a6129778c1aa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:18.908541 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-42719a74-2dd1-48f5-a80f-a6129778c1aa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:18.909226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-42719a74-2dd1-48f5-a80f-a6129778c1aa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:18.909696 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-42719a74-2dd1-48f5-a80f-a6129778c1aa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:18.910202 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-42719a74-2dd1-48f5-a80f-a6129778c1aa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:19.095461 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-42719a74-2dd1-48f5-a80f-a6129778c1aa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:19.100401 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-42719a74-2dd1-48f5-a80f-a6129778c1aa tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1363 microversion: 2.1 time: 0.204726 Sep 15 07:49:19.101173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 528/1073] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:18 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:20.104060 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9fa47190-e7cc-45c5-baab-8f9e8687ab31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:20.105256 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9fa47190-e7cc-45c5-baab-8f9e8687ab31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:20.108292 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:49:20.113611 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa47190-e7cc-45c5-baab-8f9e8687ab31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:20.114291 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa47190-e7cc-45c5-baab-8f9e8687ab31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:20.114838 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa47190-e7cc-45c5-baab-8f9e8687ab31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:20.115625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa47190-e7cc-45c5-baab-8f9e8687ab31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:20.116214 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa47190-e7cc-45c5-baab-8f9e8687ab31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:20.116641 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9fa47190-e7cc-45c5-baab-8f9e8687ab31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:20.121845 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:49:20.146184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9fa47190-e7cc-45c5-baab-8f9e8687ab31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:49:20.167297 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-ddf06c29-9a7f-4fd0-8aac-8370cce02bbf req-97d88a94-416b-44e6-90bf-59ddbdfdacbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4600a1fd-6542-4a0a-b67c-fb313d57eb82", "tag": "59dabb5f-8b21-46b0-96d6-3403654e5154"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:20.172317 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:49:20.177366 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-ddf06c29-9a7f-4fd0-8aac-8370cce02bbf req-97d88a94-416b-44e6-90bf-59ddbdfdacbb service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:20.177876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-ddf06c29-9a7f-4fd0-8aac-8370cce02bbf req-97d88a94-416b-44e6-90bf-59ddbdfdacbb service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:20.178303 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-ddf06c29-9a7f-4fd0-8aac-8370cce02bbf req-97d88a94-416b-44e6-90bf-59ddbdfdacbb service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:20.190562 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-ddf06c29-9a7f-4fd0-8aac-8370cce02bbf req-97d88a94-416b-44e6-90bf-59ddbdfdacbb service nova] Creating event network-changed:59dabb5f-8b21-46b0-96d6-3403654e5154 for instance 4600a1fd-6542-4a0a-b67c-fb313d57eb82 on hv-cinder-82414 Sep 15 07:49:20.196690 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-ddf06c29-9a7f-4fd0-8aac-8370cce02bbf req-97d88a94-416b-44e6-90bf-59ddbdfdacbb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095139 Sep 15 07:49:20.197424 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 529/1074] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:20.203269 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3cff28e8-4ea3-4633-ab40-bd9b4d4f01be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:20.204136 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3cff28e8-4ea3-4633-ab40-bd9b4d4f01be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:20.219332 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cff28e8-4ea3-4633-ab40-bd9b4d4f01be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:20.219928 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cff28e8-4ea3-4633-ab40-bd9b4d4f01be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:20.220437 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cff28e8-4ea3-4633-ab40-bd9b4d4f01be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:20.221243 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cff28e8-4ea3-4633-ab40-bd9b4d4f01be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:20.221820 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cff28e8-4ea3-4633-ab40-bd9b4d4f01be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:20.222323 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3cff28e8-4ea3-4633-ab40-bd9b4d4f01be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:20.477086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-3cff28e8-4ea3-4633-ab40-bd9b4d4f01be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:20.484999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3cff28e8-4ea3-4633-ab40-bd9b4d4f01be tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1363 microversion: 2.1 time: 0.286220 Sep 15 07:49:20.485713 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 530/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:20 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:20.542520 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9fa47190-e7cc-45c5-baab-8f9e8687ab31 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 204 len: 0 microversion: 2.1 time: 0.443085 Sep 15 07:49:20.543184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 546/1076] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:49:20 2022] DELETE /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:49:20.551932 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-571d7fd5-5169-47e4-b160-55dcd543e255 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:20.552675 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-571d7fd5-5169-47e4-b160-55dcd543e255 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:20.559857 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-571d7fd5-5169-47e4-b160-55dcd543e255 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:20.560433 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-571d7fd5-5169-47e4-b160-55dcd543e255 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:20.560937 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-571d7fd5-5169-47e4-b160-55dcd543e255 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:20.561893 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-571d7fd5-5169-47e4-b160-55dcd543e255 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:20.562477 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-571d7fd5-5169-47e4-b160-55dcd543e255 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:20.563336 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-571d7fd5-5169-47e4-b160-55dcd543e255 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:20.587009 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:49:20.701445 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-571d7fd5-5169-47e4-b160-55dcd543e255 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:20.709163 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-571d7fd5-5169-47e4-b160-55dcd543e255 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1577 microversion: 2.1 time: 0.161761 Sep 15 07:49:20.709870 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 531/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:20 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:21.509914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f9b90a62-2170-4533-b021-6a1b7b797ebc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:21.510541 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f9b90a62-2170-4533-b021-6a1b7b797ebc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:21.517561 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f9b90a62-2170-4533-b021-6a1b7b797ebc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:21.518065 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f9b90a62-2170-4533-b021-6a1b7b797ebc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:21.518513 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f9b90a62-2170-4533-b021-6a1b7b797ebc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:21.519205 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f9b90a62-2170-4533-b021-6a1b7b797ebc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:21.519657 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f9b90a62-2170-4533-b021-6a1b7b797ebc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:21.520084 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f9b90a62-2170-4533-b021-6a1b7b797ebc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:21.658816 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-f9b90a62-2170-4533-b021-6a1b7b797ebc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:21.667227 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f9b90a62-2170-4533-b021-6a1b7b797ebc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1363 microversion: 2.1 time: 0.162544 Sep 15 07:49:21.667799 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 547/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:21 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:21.733641 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-033f7443-c4f5-4984-9842-8992cfac97a0 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:21.734327 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-033f7443-c4f5-4984-9842-8992cfac97a0 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:21.741269 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-033f7443-c4f5-4984-9842-8992cfac97a0 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:21.742505 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-033f7443-c4f5-4984-9842-8992cfac97a0 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:21.743185 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-033f7443-c4f5-4984-9842-8992cfac97a0 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:21.743886 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-033f7443-c4f5-4984-9842-8992cfac97a0 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:21.744385 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-033f7443-c4f5-4984-9842-8992cfac97a0 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:21.744863 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-033f7443-c4f5-4984-9842-8992cfac97a0 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:21.954361 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-033f7443-c4f5-4984-9842-8992cfac97a0 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:21.964367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-033f7443-c4f5-4984-9842-8992cfac97a0 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1577 microversion: 2.1 time: 0.234215 Sep 15 07:49:21.964367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 532/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:21 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1577 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:22.691540 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-391e6d9b-1286-499b-b75c-ef8052a82f07 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:22.692184 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-391e6d9b-1286-499b-b75c-ef8052a82f07 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:22.698701 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391e6d9b-1286-499b-b75c-ef8052a82f07 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:22.699192 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391e6d9b-1286-499b-b75c-ef8052a82f07 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:22.699664 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391e6d9b-1286-499b-b75c-ef8052a82f07 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:22.700365 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391e6d9b-1286-499b-b75c-ef8052a82f07 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:22.700832 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391e6d9b-1286-499b-b75c-ef8052a82f07 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:22.701261 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-391e6d9b-1286-499b-b75c-ef8052a82f07 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:22.715916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-c4524ed2-1742-432a-822f-66fe48d475c3 req-1f7b93a2-5261-42a0-9908-5950f4db8094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4600a1fd-6542-4a0a-b67c-fb313d57eb82", "name": "network-vif-deleted", "tag": "59dabb5f-8b21-46b0-96d6-3403654e5154"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:22.726689 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c4524ed2-1742-432a-822f-66fe48d475c3 req-1f7b93a2-5261-42a0-9908-5950f4db8094 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:22.727172 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c4524ed2-1742-432a-822f-66fe48d475c3 req-1f7b93a2-5261-42a0-9908-5950f4db8094 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:22.727713 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-c4524ed2-1742-432a-822f-66fe48d475c3 req-1f7b93a2-5261-42a0-9908-5950f4db8094 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:22.739844 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-c4524ed2-1742-432a-822f-66fe48d475c3 req-1f7b93a2-5261-42a0-9908-5950f4db8094 service nova] Creating event network-vif-deleted:59dabb5f-8b21-46b0-96d6-3403654e5154 for instance 4600a1fd-6542-4a0a-b67c-fb313d57eb82 on hv-cinder-82414 Sep 15 07:49:22.745425 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-c4524ed2-1742-432a-822f-66fe48d475c3 req-1f7b93a2-5261-42a0-9908-5950f4db8094 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 Sep 15 07:49:22.746296 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 533/1080] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:49:22.840232 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-391e6d9b-1286-499b-b75c-ef8052a82f07 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:22.849057 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-391e6d9b-1286-499b-b75c-ef8052a82f07 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1363 microversion: 2.1 time: 0.162304 Sep 15 07:49:22.849637 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 548/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:22 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:22.987580 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-6b864dbf-3f09-47ef-953a-683b73094116 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:22.988358 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-6b864dbf-3f09-47ef-953a-683b73094116 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:22.994819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b864dbf-3f09-47ef-953a-683b73094116 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:22.995306 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b864dbf-3f09-47ef-953a-683b73094116 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:22.995918 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b864dbf-3f09-47ef-953a-683b73094116 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:22.996801 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b864dbf-3f09-47ef-953a-683b73094116 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:22.997252 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b864dbf-3f09-47ef-953a-683b73094116 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:22.997698 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-6b864dbf-3f09-47ef-953a-683b73094116 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:23.079658 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-6b864dbf-3f09-47ef-953a-683b73094116 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:23.089678 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-6b864dbf-3f09-47ef-953a-683b73094116 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 200 len: 1225 microversion: 2.1 time: 0.106036 Sep 15 07:49:23.090338 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 534/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:22 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:23.873457 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-9f5065f9-bc82-4e71-a9c2-5397af8837e7 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:23.874099 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-9f5065f9-bc82-4e71-a9c2-5397af8837e7 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:23.880767 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9f5065f9-bc82-4e71-a9c2-5397af8837e7 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:23.881259 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9f5065f9-bc82-4e71-a9c2-5397af8837e7 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:23.881725 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9f5065f9-bc82-4e71-a9c2-5397af8837e7 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:23.883216 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9f5065f9-bc82-4e71-a9c2-5397af8837e7 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:23.883672 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9f5065f9-bc82-4e71-a9c2-5397af8837e7 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:23.884096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-9f5065f9-bc82-4e71-a9c2-5397af8837e7 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:24.014322 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-9f5065f9-bc82-4e71-a9c2-5397af8837e7 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:24.021771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-9f5065f9-bc82-4e71-a9c2-5397af8837e7 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1363 microversion: 2.1 time: 0.153236 Sep 15 07:49:24.022337 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 549/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:23 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:24.113101 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:24.113740 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 4600a1fd-6542-4a0a-b67c-fb313d57eb82] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:24.115868 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=2 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:49:24.116751 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell0:SELECT=6 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:49:24.121419 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:24.121931 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:24.126519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:24.126519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:24.126519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:24.126519 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:24.137985 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] HTTP exception thrown: Instance 4600a1fd-6542-4a0a-b67c-fb313d57eb82 could not be found. Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Request method failure captured: Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 HTTP/1.1 Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItcWC41YL-jEVAfW5k8T8Z8Masg0gZERzqCt59hTF6N1xH-NPU0wnCafBgJJ2gizVmrnurujP53HbFQ1SX7gc3wojMxYvmcKhb-vjgp7tOgfGMyR7rh8MDYWjMfSKbXxbPPBa7xkGFBsroXBEh8YllbqAQmdCdq6XRCteGS7aDC2hJc Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: af1e008c4bfa41e18488c63ea0f17b27 Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:49:24.139577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af1e008c4bfa41e18488c63ea0f17b27"}]}] Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: af1e008c4bfa41e18488c63ea0f17b27 Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-TestVolumeBootPattern-610100506-project Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: ebd85e42855448268c89a200f4392316 Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-TestVolumeBootPattern-610100506-project Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 4600a1fd-6542-4a0a-b67c-fb313d57eb82 could not be found. Sep 15 07:49:24.141183 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '4600a1fd-6542-4a0a-b67c-fb313d57eb82'} Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4600a1fd-6542-4a0a-b67c-fb313d57eb82 could not be found. Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:49:24.142226 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4600a1fd-6542-4a0a-b67c-fb313d57eb82 could not be found. Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4600a1fd-6542-4a0a-b67c-fb313d57eb82 could not be found. Sep 15 07:49:24.143707 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:24.145252 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Returning 404 to user: Instance 4600a1fd-6542-4a0a-b67c-fb313d57eb82 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:49:24.145252 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-84ff354b-fe20-440d-8416-f514c6ede785 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82" status: 404 len: 111 microversion: 2.1 time: 0.031688 Sep 15 07:49:24.145252 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 535/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:24 2022] GET /compute/v2.1/servers/4600a1fd-6542-4a0a-b67c-fb313d57eb82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:49:24.732233 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell0:SELECT=6 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:49:24.787505 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-f398f70f-d1e9-4faf-a6a4-0baf2a7ceea4 req-0cf33bd7-853e-4fa0-a59e-a224b72aab72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd", "name": "network-vif-plugged", "status": "completed", "tag": "a9942a95-f13c-4b93-b3ea-9e337fbfb77e"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:24.798430 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f398f70f-d1e9-4faf-a6a4-0baf2a7ceea4 req-0cf33bd7-853e-4fa0-a59e-a224b72aab72 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:24.798914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f398f70f-d1e9-4faf-a6a4-0baf2a7ceea4 req-0cf33bd7-853e-4fa0-a59e-a224b72aab72 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:24.799371 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-f398f70f-d1e9-4faf-a6a4-0baf2a7ceea4 req-0cf33bd7-853e-4fa0-a59e-a224b72aab72 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:24.811127 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-f398f70f-d1e9-4faf-a6a4-0baf2a7ceea4 req-0cf33bd7-853e-4fa0-a59e-a224b72aab72 service nova] Creating event network-vif-plugged:a9942a95-f13c-4b93-b3ea-9e337fbfb77e for instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd on hv-cinder-82414 Sep 15 07:49:24.816224 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-f398f70f-d1e9-4faf-a6a4-0baf2a7ceea4 req-0cf33bd7-853e-4fa0-a59e-a224b72aab72 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088761 Sep 15 07:49:24.816813 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 550/1085] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:25.045013 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-8b0fb23f-0992-42eb-803a-6cc2cb7ef172 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:25.045653 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-8b0fb23f-0992-42eb-803a-6cc2cb7ef172 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:25.052520 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b0fb23f-0992-42eb-803a-6cc2cb7ef172 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:25.053014 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b0fb23f-0992-42eb-803a-6cc2cb7ef172 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:25.053448 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b0fb23f-0992-42eb-803a-6cc2cb7ef172 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:25.054242 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b0fb23f-0992-42eb-803a-6cc2cb7ef172 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:25.054623 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b0fb23f-0992-42eb-803a-6cc2cb7ef172 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:25.055049 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-8b0fb23f-0992-42eb-803a-6cc2cb7ef172 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:25.249251 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-8b0fb23f-0992-42eb-803a-6cc2cb7ef172 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:25.256880 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-8b0fb23f-0992-42eb-803a-6cc2cb7ef172 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1363 microversion: 2.1 time: 0.215896 Sep 15 07:49:25.257539 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 536/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:25 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 07:49:26.282050 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-25887453-a52d-40cf-ba21-1bccc236913b tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:26.282673 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-25887453-a52d-40cf-ba21-1bccc236913b tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:26.289565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25887453-a52d-40cf-ba21-1bccc236913b tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:26.293533 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25887453-a52d-40cf-ba21-1bccc236913b tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:26.293533 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25887453-a52d-40cf-ba21-1bccc236913b tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:26.293533 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25887453-a52d-40cf-ba21-1bccc236913b tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:26.293533 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25887453-a52d-40cf-ba21-1bccc236913b tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:26.293951 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-25887453-a52d-40cf-ba21-1bccc236913b tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:26.422996 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-25887453-a52d-40cf-ba21-1bccc236913b tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:26.430572 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-25887453-a52d-40cf-ba21-1bccc236913b tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1363 microversion: 2.1 time: 0.153595 Sep 15 07:49:26.431381 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 551/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:26 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:27.454366 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-cc35d1c7-12de-42d0-b587-d9c760789715 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:27.455294 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-cc35d1c7-12de-42d0-b587-d9c760789715 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:27.462699 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cc35d1c7-12de-42d0-b587-d9c760789715 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:27.463476 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cc35d1c7-12de-42d0-b587-d9c760789715 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:27.463896 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cc35d1c7-12de-42d0-b587-d9c760789715 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:27.464601 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cc35d1c7-12de-42d0-b587-d9c760789715 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:27.465086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cc35d1c7-12de-42d0-b587-d9c760789715 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:27.465513 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cc35d1c7-12de-42d0-b587-d9c760789715 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:27.559121 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-aaa3be02-e966-4f6a-b94f-78ea63c57f3e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:27.560192 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-aaa3be02-e966-4f6a-b94f-78ea63c57f3e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:27.567139 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aaa3be02-e966-4f6a-b94f-78ea63c57f3e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:27.568536 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aaa3be02-e966-4f6a-b94f-78ea63c57f3e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:27.568536 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aaa3be02-e966-4f6a-b94f-78ea63c57f3e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:27.568933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aaa3be02-e966-4f6a-b94f-78ea63c57f3e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:27.569378 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aaa3be02-e966-4f6a-b94f-78ea63c57f3e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:27.569836 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-aaa3be02-e966-4f6a-b94f-78ea63c57f3e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:27.597091 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-aaa3be02-e966-4f6a-b94f-78ea63c57f3e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Going to try to terminate instance {{(pid=132674) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:49:27.620010 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-cc35d1c7-12de-42d0-b587-d9c760789715 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:27.628270 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-cc35d1c7-12de-42d0-b587-d9c760789715 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1549 microversion: 2.1 time: 0.177893 Sep 15 07:49:27.641762 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 537/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:27 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1549 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:27.646704 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-941530a8-6e2e-4e60-bcbf-768c15bd881f req-b85deb4d-52f3-4b0c-b008-5eda588ac2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbef2c3-07c4-4165-b994-cf399a858379", "tag": "3f042454-cf32-4a00-ae9e-6827217983a6"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:27.656274 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-941530a8-6e2e-4e60-bcbf-768c15bd881f req-b85deb4d-52f3-4b0c-b008-5eda588ac2f5 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:27.656746 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-941530a8-6e2e-4e60-bcbf-768c15bd881f req-b85deb4d-52f3-4b0c-b008-5eda588ac2f5 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:27.657174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-941530a8-6e2e-4e60-bcbf-768c15bd881f req-b85deb4d-52f3-4b0c-b008-5eda588ac2f5 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:27.668678 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-941530a8-6e2e-4e60-bcbf-768c15bd881f req-b85deb4d-52f3-4b0c-b008-5eda588ac2f5 service nova] Creating event network-changed:3f042454-cf32-4a00-ae9e-6827217983a6 for instance fbbef2c3-07c4-4165-b994-cf399a858379 on hv-cinder-82414 Sep 15 07:49:27.673650 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-941530a8-6e2e-4e60-bcbf-768c15bd881f req-b85deb4d-52f3-4b0c-b008-5eda588ac2f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030521 Sep 15 07:49:27.674233 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 538/1089] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:27.679275 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-3db83f6b-22ab-49da-975b-6a55b342bdd2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:27.679964 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-3db83f6b-22ab-49da-975b-6a55b342bdd2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:27.686048 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3db83f6b-22ab-49da-975b-6a55b342bdd2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:27.686528 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3db83f6b-22ab-49da-975b-6a55b342bdd2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:27.686961 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3db83f6b-22ab-49da-975b-6a55b342bdd2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:27.687648 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3db83f6b-22ab-49da-975b-6a55b342bdd2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:27.688276 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3db83f6b-22ab-49da-975b-6a55b342bdd2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:27.688858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-3db83f6b-22ab-49da-975b-6a55b342bdd2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:27.804164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-3db83f6b-22ab-49da-975b-6a55b342bdd2 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128702 Sep 15 07:49:27.805164 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 539/1090] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 15 07:49:27 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:27.990381 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-aaa3be02-e966-4f6a-b94f-78ea63c57f3e tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 204 len: 0 microversion: 2.1 time: 0.435987 Sep 15 07:49:27.991339 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 552/1091] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:49:27 2022] DELETE /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 15 07:49:28.002165 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-f383e34e-ccb6-4bd6-bfe9-c35055ceaf42 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:28.002165 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-f383e34e-ccb6-4bd6-bfe9-c35055ceaf42 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:28.007516 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f383e34e-ccb6-4bd6-bfe9-c35055ceaf42 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:28.008383 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f383e34e-ccb6-4bd6-bfe9-c35055ceaf42 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:28.008827 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f383e34e-ccb6-4bd6-bfe9-c35055ceaf42 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:28.009788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f383e34e-ccb6-4bd6-bfe9-c35055ceaf42 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:28.010472 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f383e34e-ccb6-4bd6-bfe9-c35055ceaf42 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:28.011068 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-f383e34e-ccb6-4bd6-bfe9-c35055ceaf42 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:28.153290 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-f383e34e-ccb6-4bd6-bfe9-c35055ceaf42 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:28.162344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-f383e34e-ccb6-4bd6-bfe9-c35055ceaf42 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1579 microversion: 2.1 time: 0.165761 Sep 15 07:49:28.163217 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 540/1092] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:27 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:29.187280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-12e26d82-fbbf-4d8a-9c70-7e2012fd525a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:29.187986 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-12e26d82-fbbf-4d8a-9c70-7e2012fd525a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:29.194355 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-12e26d82-fbbf-4d8a-9c70-7e2012fd525a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:29.194844 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-12e26d82-fbbf-4d8a-9c70-7e2012fd525a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:29.195826 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-12e26d82-fbbf-4d8a-9c70-7e2012fd525a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:29.196519 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-12e26d82-fbbf-4d8a-9c70-7e2012fd525a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:29.196971 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-12e26d82-fbbf-4d8a-9c70-7e2012fd525a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:29.197502 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-12e26d82-fbbf-4d8a-9c70-7e2012fd525a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:29.398186 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-12e26d82-fbbf-4d8a-9c70-7e2012fd525a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:29.406239 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-12e26d82-fbbf-4d8a-9c70-7e2012fd525a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1579 microversion: 2.1 time: 0.223209 Sep 15 07:49:29.406915 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 553/1093] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:29 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1579 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:29.689742 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-58f8022b-de2e-41e2-a4b6-23f09d94b058 req-ca1b2533-59c8-4830-ae5a-aa3477375d4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd", "tag": "a9942a95-f13c-4b93-b3ea-9e337fbfb77e"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:29.700610 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-58f8022b-de2e-41e2-a4b6-23f09d94b058 req-ca1b2533-59c8-4830-ae5a-aa3477375d4d service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:29.701100 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-58f8022b-de2e-41e2-a4b6-23f09d94b058 req-ca1b2533-59c8-4830-ae5a-aa3477375d4d service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:29.701788 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-58f8022b-de2e-41e2-a4b6-23f09d94b058 req-ca1b2533-59c8-4830-ae5a-aa3477375d4d service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:29.715086 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-58f8022b-de2e-41e2-a4b6-23f09d94b058 req-ca1b2533-59c8-4830-ae5a-aa3477375d4d service nova] Creating event network-changed:a9942a95-f13c-4b93-b3ea-9e337fbfb77e for instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd on hv-cinder-82414 Sep 15 07:49:29.720310 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-58f8022b-de2e-41e2-a4b6-23f09d94b058 req-ca1b2533-59c8-4830-ae5a-aa3477375d4d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034210 Sep 15 07:49:29.721147 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 541/1094] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:30.088221 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [req-a632b31a-5c93-4650-b281-9fe3a6beeba5 req-95516e9c-f39a-4d60-a69b-d9c0484c17b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbef2c3-07c4-4165-b994-cf399a858379", "name": "network-vif-deleted", "tag": "3f042454-cf32-4a00-ae9e-6827217983a6"}]} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:30.098004 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-a632b31a-5c93-4650-b281-9fe3a6beeba5 req-95516e9c-f39a-4d60-a69b-d9c0484c17b5 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:30.098577 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-a632b31a-5c93-4650-b281-9fe3a6beeba5 req-95516e9c-f39a-4d60-a69b-d9c0484c17b5 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:30.099090 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [req-a632b31a-5c93-4650-b281-9fe3a6beeba5 req-95516e9c-f39a-4d60-a69b-d9c0484c17b5 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:30.111082 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.compute.server_external_events [req-a632b31a-5c93-4650-b281-9fe3a6beeba5 req-95516e9c-f39a-4d60-a69b-d9c0484c17b5 service nova] Creating event network-vif-deleted:3f042454-cf32-4a00-ae9e-6827217983a6 for instance fbbef2c3-07c4-4165-b994-cf399a858379 on hv-cinder-82414 Sep 15 07:49:30.116107 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [req-a632b31a-5c93-4650-b281-9fe3a6beeba5 req-95516e9c-f39a-4d60-a69b-d9c0484c17b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032116 Sep 15 07:49:30.117037 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 554/1095] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:30.430905 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e42be0e6-5477-4015-9e9c-8a5a88d83deb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:30.431600 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e42be0e6-5477-4015-9e9c-8a5a88d83deb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:30.438760 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e42be0e6-5477-4015-9e9c-8a5a88d83deb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:30.439247 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e42be0e6-5477-4015-9e9c-8a5a88d83deb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:30.439750 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e42be0e6-5477-4015-9e9c-8a5a88d83deb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:30.440647 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e42be0e6-5477-4015-9e9c-8a5a88d83deb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:30.441095 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e42be0e6-5477-4015-9e9c-8a5a88d83deb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:30.441513 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e42be0e6-5477-4015-9e9c-8a5a88d83deb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:30.511280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-e42be0e6-5477-4015-9e9c-8a5a88d83deb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebd85e42855448268c89a200f4392316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1e008c4bfa41e18488c63ea0f17b27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:30.520366 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e42be0e6-5477-4015-9e9c-8a5a88d83deb tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 200 len: 1226 microversion: 2.1 time: 0.093948 Sep 15 07:49:30.520919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 542/1096] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:30 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:31.544427 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:31.545159 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: fbbef2c3-07c4-4165-b994-cf399a858379] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:31.551275 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:31.551757 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:31.552195 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:31.556872 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:31.556872 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:31.556872 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:31.567497 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] HTTP exception thrown: Instance fbbef2c3-07c4-4165-b994-cf399a858379 could not be found. Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Request method failure captured: Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 HTTP/1.1 Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItcWC41YL-jEVAfW5k8T8Z8Masg0gZERzqCt59hTF6N1xH-NPU0wnCafBgJJ2gizVmrnurujP53HbFQ1SX7gc3wojMxYvmcKhb-vjgp7tOgfGMyR7rh8MDYWjMfSKbXxbPPBa7xkGFBsroXBEh8YllbqAQmdCdq6XRCteGS7aDC2hJc Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: af1e008c4bfa41e18488c63ea0f17b27 Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:49:31.569096 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af1e008c4bfa41e18488c63ea0f17b27"}]}] Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: af1e008c4bfa41e18488c63ea0f17b27 Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-TestVolumeBootPattern-610100506-project Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: ebd85e42855448268c89a200f4392316 Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-TestVolumeBootPattern-610100506-project Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance fbbef2c3-07c4-4165-b994-cf399a858379 could not be found. Sep 15 07:49:31.571434 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': 'fbbef2c3-07c4-4165-b994-cf399a858379'} Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbbef2c3-07c4-4165-b994-cf399a858379 could not be found. Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:49:31.572341 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbbef2c3-07c4-4165-b994-cf399a858379 could not be found. Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbbef2c3-07c4-4165-b994-cf399a858379 could not be found. Sep 15 07:49:31.573881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:31.575204 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Returning 404 to user: Instance fbbef2c3-07c4-4165-b994-cf399a858379 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:49:31.575204 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-a10735ca-3962-46bc-ac42-2b046056d477 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379" status: 404 len: 111 microversion: 2.1 time: 0.031958 Sep 15 07:49:31.575204 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 555/1097] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:31 2022] GET /compute/v2.1/servers/fbbef2c3-07c4-4165-b994-cf399a858379 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:49:32.306386 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:32.307009 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:32.313415 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:32.314018 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:32.314449 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:32.315134 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:32.315582 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:32.315999 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:32.329612 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] HTTP exception thrown: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Request method failure captured: Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: DELETE /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 HTTP/1.1 Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItcWC41YL-jEVAfW5k8T8Z8Masg0gZERzqCt59hTF6N1xH-NPU0wnCafBgJJ2gizVmrnurujP53HbFQ1SX7gc3wojMxYvmcKhb-vjgp7tOgfGMyR7rh8MDYWjMfSKbXxbPPBa7xkGFBsroXBEh8YllbqAQmdCdq6XRCteGS7aDC2hJc Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: af1e008c4bfa41e18488c63ea0f17b27 Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:49:32.331339 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af1e008c4bfa41e18488c63ea0f17b27"}]}] Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: af1e008c4bfa41e18488c63ea0f17b27 Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-TestVolumeBootPattern-610100506-project Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: ebd85e42855448268c89a200f4392316 Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-TestVolumeBootPattern-610100506-project Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:49:32.332899 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '7cfb1a22-faac-4d66-874d-e7866a02a054'} Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:49:32.334022 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:49:32.336088 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:32.338059 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Returning 404 to user: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:49:32.338059 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-aac7e6b0-cc32-4deb-85ac-d44687242cf6 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 404 len: 111 microversion: 2.1 time: 0.030463 Sep 15 07:49:32.338059 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 543/1098] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:49:32 2022] DELETE /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:49:32.342561 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:32.343208 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] [instance: 7cfb1a22-faac-4d66-874d-e7866a02a054] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:32.349330 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:32.349869 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:32.350301 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:32.353985 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:32.353985 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:32.353985 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:32.366880 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] HTTP exception thrown: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Request method failure captured: Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 HTTP/1.1 Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItcWC41YL-jEVAfW5k8T8Z8Masg0gZERzqCt59hTF6N1xH-NPU0wnCafBgJJ2gizVmrnurujP53HbFQ1SX7gc3wojMxYvmcKhb-vjgp7tOgfGMyR7rh8MDYWjMfSKbXxbPPBa7xkGFBsroXBEh8YllbqAQmdCdq6XRCteGS7aDC2hJc Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: af1e008c4bfa41e18488c63ea0f17b27 Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:49:32.368464 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af1e008c4bfa41e18488c63ea0f17b27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af1e008c4bfa41e18488c63ea0f17b27"}]}] Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: af1e008c4bfa41e18488c63ea0f17b27 Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-TestVolumeBootPattern-610100506 Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-TestVolumeBootPattern-610100506-project Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: ebd85e42855448268c89a200f4392316 Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-TestVolumeBootPattern-610100506-project Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:49:32.369906 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '7cfb1a22-faac-4d66-874d-e7866a02a054'} Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:49:32.370686 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. Sep 15 07:49:32.372142 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:32.373516 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Returning 404 to user: Instance 7cfb1a22-faac-4d66-874d-e7866a02a054 could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:49:32.373516 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-da709266-a7ea-40f6-bf50-ba93b4f6f22a tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054" status: 404 len: 111 microversion: 2.1 time: 0.031116 Sep 15 07:49:32.373516 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 556/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:32 2022] GET /compute/v2.1/servers/7cfb1a22-faac-4d66-874d-e7866a02a054 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 07:49:33.844151 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-b56f343d-fb71-40a0-b946-b93da1877a01 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] Calling method '.version_select at 0x7ff36c7ebe50>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:33.919983 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-b56f343d-fb71-40a0-b946-b93da1877a01 tempest-TestVolumeBootPattern-610100506 tempest-TestVolumeBootPattern-610100506-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2002691772" status: 202 len: 0 microversion: 2.1 time: 0.079670 Sep 15 07:49:33.920565 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 544/1100] 10.222.0.42 () {58 vars in 1263 bytes} [Thu Sep 15 07:49:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2002691772 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:49:34.060591 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-b0139011-32a0-441f-b348-b85cb0f0c404 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1905868263"}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:34.061145 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-b0139011-32a0-441f-b348-b85cb0f0c404 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:34.067885 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b0139011-32a0-441f-b348-b85cb0f0c404 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:34.068377 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b0139011-32a0-441f-b348-b85cb0f0c404 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:34.068819 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b0139011-32a0-441f-b348-b85cb0f0c404 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:34.069527 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b0139011-32a0-441f-b348-b85cb0f0c404 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:34.070156 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b0139011-32a0-441f-b348-b85cb0f0c404 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:34.070874 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-b0139011-32a0-441f-b348-b85cb0f0c404 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:34.329791 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.network.security_group_api [None req-b0139011-32a0-441f-b348-b85cb0f0c404 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Removing security group 408b2aa9-b550-4c7d-a697-0e509d9d3a37 from port 9499e9bc-c07e-4389-a2e2-415f7d2c8088 Sep 15 07:49:34.933597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-b0139011-32a0-441f-b348-b85cb0f0c404 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "POST /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/action" status: 202 len: 0 microversion: 2.1 time: 0.876830 Sep 15 07:49:34.934532 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 557/1101] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 15 07:49:34 2022] POST /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/action => generated 0 bytes in 878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:49:34.952539 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-29bed13e-dea7-4540-b361-d061f1c3868e req-41059d27-262b-45b6-9884-90194effc222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533c974f-14a5-43e3-a746-c3156eae4282", "tag": "9499e9bc-c07e-4389-a2e2-415f7d2c8088"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:34.978764 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-29bed13e-dea7-4540-b361-d061f1c3868e req-41059d27-262b-45b6-9884-90194effc222 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:34.979523 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-29bed13e-dea7-4540-b361-d061f1c3868e req-41059d27-262b-45b6-9884-90194effc222 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:34.979973 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-29bed13e-dea7-4540-b361-d061f1c3868e req-41059d27-262b-45b6-9884-90194effc222 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:34.997827 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-29bed13e-dea7-4540-b361-d061f1c3868e req-41059d27-262b-45b6-9884-90194effc222 service nova] Creating event network-changed:9499e9bc-c07e-4389-a2e2-415f7d2c8088 for instance 533c974f-14a5-43e3-a746-c3156eae4282 on hv-cinder-82414 Sep 15 07:49:35.029480 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-29bed13e-dea7-4540-b361-d061f1c3868e req-41059d27-262b-45b6-9884-90194effc222 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070915 Sep 15 07:49:35.037234 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 545/1102] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:37.030883 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fa669560-6423-4bf2-a5c7-445bcc235af5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:37.031446 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-fa669560-6423-4bf2-a5c7-445bcc235af5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:37.037655 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa669560-6423-4bf2-a5c7-445bcc235af5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:37.038182 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa669560-6423-4bf2-a5c7-445bcc235af5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:37.038694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa669560-6423-4bf2-a5c7-445bcc235af5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:37.039510 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa669560-6423-4bf2-a5c7-445bcc235af5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:37.039965 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa669560-6423-4bf2-a5c7-445bcc235af5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:37.040544 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa669560-6423-4bf2-a5c7-445bcc235af5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:37.056017 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-40714d46-ea43-43bd-a281-e97b3abb2f5a req-200759e5-8937-4bdb-bc1a-a2ab84722cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533c974f-14a5-43e3-a746-c3156eae4282", "tag": "9499e9bc-c07e-4389-a2e2-415f7d2c8088"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:37.078324 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-40714d46-ea43-43bd-a281-e97b3abb2f5a req-200759e5-8937-4bdb-bc1a-a2ab84722cc7 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:37.078919 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-40714d46-ea43-43bd-a281-e97b3abb2f5a req-200759e5-8937-4bdb-bc1a-a2ab84722cc7 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:37.079442 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-40714d46-ea43-43bd-a281-e97b3abb2f5a req-200759e5-8937-4bdb-bc1a-a2ab84722cc7 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:37.103710 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-40714d46-ea43-43bd-a281-e97b3abb2f5a req-200759e5-8937-4bdb-bc1a-a2ab84722cc7 service nova] Creating event network-changed:9499e9bc-c07e-4389-a2e2-415f7d2c8088 for instance 533c974f-14a5-43e3-a746-c3156eae4282 on hv-cinder-82414 Sep 15 07:49:37.109392 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-40714d46-ea43-43bd-a281-e97b3abb2f5a req-200759e5-8937-4bdb-bc1a-a2ab84722cc7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057787 Sep 15 07:49:37.110744 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 546/1103] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:49:37.167241 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-fa669560-6423-4bf2-a5c7-445bcc235af5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lazy-loading 'services' on Instance uuid 533c974f-14a5-43e3-a746-c3156eae4282 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:49:37.353691 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fa669560-6423-4bf2-a5c7-445bcc235af5 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "DELETE /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments/998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5" status: 202 len: 0 microversion: 2.1 time: 0.326860 Sep 15 07:49:37.354330 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 558/1104] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:49:37 2022] DELETE /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments/998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:49:37.365094 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-28c55f1f-77ba-44ec-8dc1-f633941bb0db tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:37.369443 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-28c55f1f-77ba-44ec-8dc1-f633941bb0db tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:37.376122 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c55f1f-77ba-44ec-8dc1-f633941bb0db tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:37.379684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c55f1f-77ba-44ec-8dc1-f633941bb0db tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:37.379684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c55f1f-77ba-44ec-8dc1-f633941bb0db tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:37.379684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c55f1f-77ba-44ec-8dc1-f633941bb0db tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:37.379684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c55f1f-77ba-44ec-8dc1-f633941bb0db tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:37.380157 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-28c55f1f-77ba-44ec-8dc1-f633941bb0db tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:37.416000 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-28c55f1f-77ba-44ec-8dc1-f633941bb0db tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056977 Sep 15 07:49:37.417360 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 547/1105] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:49:37 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:38.430565 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-31d8b60f-601b-4b27-92af-6ea57d3f262a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:38.434699 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-31d8b60f-601b-4b27-92af-6ea57d3f262a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:38.441692 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31d8b60f-601b-4b27-92af-6ea57d3f262a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:38.442342 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31d8b60f-601b-4b27-92af-6ea57d3f262a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:38.442903 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31d8b60f-601b-4b27-92af-6ea57d3f262a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:38.443894 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31d8b60f-601b-4b27-92af-6ea57d3f262a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:38.445177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31d8b60f-601b-4b27-92af-6ea57d3f262a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:38.445788 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-31d8b60f-601b-4b27-92af-6ea57d3f262a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:38.480851 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-31d8b60f-601b-4b27-92af-6ea57d3f262a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054646 Sep 15 07:49:38.481594 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 559/1106] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:49:38 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:39.492763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-84cf1645-abba-472d-92c6-726abdc146ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:39.495216 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-84cf1645-abba-472d-92c6-726abdc146ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:39.502714 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84cf1645-abba-472d-92c6-726abdc146ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:39.503204 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84cf1645-abba-472d-92c6-726abdc146ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:39.503665 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84cf1645-abba-472d-92c6-726abdc146ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:39.504367 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84cf1645-abba-472d-92c6-726abdc146ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:39.504985 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84cf1645-abba-472d-92c6-726abdc146ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:39.505231 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-84cf1645-abba-472d-92c6-726abdc146ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:39.537658 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-84cf1645-abba-472d-92c6-726abdc146ed tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048800 Sep 15 07:49:39.538890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 548/1107] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:49:39 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 07:49:39.549940 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:39.550561 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:39.557188 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:39.557736 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:39.558177 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:39.558909 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:39.559336 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:39.559756 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:39.641192 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] HTTP exception thrown: Instance 533c974f-14a5-43e3-a746-c3156eae4282 is not attached to volume 998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5 Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Request method failure captured: Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: DELETE /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments/998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5 HTTP/1.1 Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItiQG4TQ5nhEp9hO4sylJGQTArP70SF0UhqrRGFMxWCDuzI6bU6peOsGwojHf1bfmNA5T3kuB5kmgO-kviDaDbwCT1qZOzTVt2dRJo82eMUeUrc_3pXHmYET9KZCQquw9fkXlQnbJz9e86Tobl5buPsOy1cvqhAz1nYANJrnV768VGg Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: 00091272c5a745f2bf80723a69fbfc61 Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-TestMinimumBasicScenario-1849070686 Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:49:39.643815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:49:39.645761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_00091272c5a745f2bf80723a69fbfc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/00091272c5a745f2bf80723a69fbfc61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/00091272c5a745f2bf80723a69fbfc61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/00091272c5a745f2bf80723a69fbfc61"}]}] Sep 15 07:49:39.645761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-TestMinimumBasicScenario-1849070686 Sep 15 07:49:39.645761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: 00091272c5a745f2bf80723a69fbfc61 Sep 15 07:49:39.645761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1849070686 Sep 15 07:49:39.645761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-TestMinimumBasicScenario-1849070686-project Sep 15 07:49:39.645761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:49:39.645761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:49:39.645761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: f4c762318a844714b585f80fdfa9ef53 Sep 15 07:49:39.645761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-TestMinimumBasicScenario-1849070686-project Sep 15 07:49:39.645761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:49:39.645761 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 533c974f-14a5-43e3-a746-c3156eae4282 is not attached to volume 998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5 Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'server_id': '533c974f-14a5-43e3-a746-c3156eae4282', 'id': '998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5'} Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5. Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:49:39.647249 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533c974f-14a5-43e3-a746-c3156eae4282 is not attached to volume 998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5 Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533c974f-14a5-43e3-a746-c3156eae4282 is not attached to volume 998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5 Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:49:39.649312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Returning 404 to user: Instance 533c974f-14a5-43e3-a746-c3156eae4282 is not attached to volume 998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5 {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:49:39.656850 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-026cda19-445f-4899-afa5-f3e805376ee0 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "DELETE /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments/998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5" status: 404 len: 154 microversion: 2.1 time: 0.099632 Sep 15 07:49:39.656850 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 560/1108] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:49:39 2022] DELETE /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282/os-volume_attachments/998c4aa8-69f2-46dc-9b5d-29c7daa3d4a5 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:49:40.896804 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-e17a8643-b4ed-4496-958c-9eb29fa24f7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:40.898422 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e17a8643-b4ed-4496-958c-9eb29fa24f7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:40.904533 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e17a8643-b4ed-4496-958c-9eb29fa24f7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:40.905026 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e17a8643-b4ed-4496-958c-9eb29fa24f7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:40.905670 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e17a8643-b4ed-4496-958c-9eb29fa24f7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:40.906597 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e17a8643-b4ed-4496-958c-9eb29fa24f7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:40.907058 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e17a8643-b4ed-4496-958c-9eb29fa24f7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:40.907679 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-e17a8643-b4ed-4496-958c-9eb29fa24f7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:40.934890 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-e17a8643-b4ed-4496-958c-9eb29fa24f7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Going to try to terminate instance {{(pid=132673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:49:41.250152 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-e17a8643-b4ed-4496-958c-9eb29fa24f7a tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "DELETE /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 204 len: 0 microversion: 2.1 time: 0.357255 Sep 15 07:49:41.250701 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 549/1109] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:49:40 2022] DELETE /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:49:41.259414 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-47e2c5d4-2bf7-4959-bfa0-ec62ac6133fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:41.259966 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-47e2c5d4-2bf7-4959-bfa0-ec62ac6133fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:41.266858 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47e2c5d4-2bf7-4959-bfa0-ec62ac6133fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:41.267340 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47e2c5d4-2bf7-4959-bfa0-ec62ac6133fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:41.267771 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47e2c5d4-2bf7-4959-bfa0-ec62ac6133fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:41.268674 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47e2c5d4-2bf7-4959-bfa0-ec62ac6133fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:41.269126 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47e2c5d4-2bf7-4959-bfa0-ec62ac6133fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:41.269605 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-47e2c5d4-2bf7-4959-bfa0-ec62ac6133fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:41.422070 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-47e2c5d4-2bf7-4959-bfa0-ec62ac6133fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:41.424376 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:49:41.431520 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-47e2c5d4-2bf7-4959-bfa0-ec62ac6133fb tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1553 microversion: 2.1 time: 0.176179 Sep 15 07:49:41.432088 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 561/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:41 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:42.456105 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-67f7ea5d-6fd4-4140-b2e6-acf7c237eba9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:42.456799 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-67f7ea5d-6fd4-4140-b2e6-acf7c237eba9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:42.465674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-67f7ea5d-6fd4-4140-b2e6-acf7c237eba9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:42.465674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-67f7ea5d-6fd4-4140-b2e6-acf7c237eba9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:42.465674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-67f7ea5d-6fd4-4140-b2e6-acf7c237eba9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:42.466320 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-67f7ea5d-6fd4-4140-b2e6-acf7c237eba9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:42.466775 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-67f7ea5d-6fd4-4140-b2e6-acf7c237eba9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:42.467202 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-67f7ea5d-6fd4-4140-b2e6-acf7c237eba9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:42.609372 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-67f7ea5d-6fd4-4140-b2e6-acf7c237eba9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:42.618167 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-67f7ea5d-6fd4-4140-b2e6-acf7c237eba9 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1553 microversion: 2.1 time: 0.166397 Sep 15 07:49:42.618677 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 550/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:42 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:43.642784 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-04a76046-ac5b-4655-b6ec-01583f036b2d tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:43.643794 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-04a76046-ac5b-4655-b6ec-01583f036b2d tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:43.651558 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-04a76046-ac5b-4655-b6ec-01583f036b2d tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:43.652313 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-04a76046-ac5b-4655-b6ec-01583f036b2d tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:43.652984 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-04a76046-ac5b-4655-b6ec-01583f036b2d tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:43.654118 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-04a76046-ac5b-4655-b6ec-01583f036b2d tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:43.654779 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-04a76046-ac5b-4655-b6ec-01583f036b2d tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:43.655406 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-04a76046-ac5b-4655-b6ec-01583f036b2d tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:43.726492 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-04a76046-ac5b-4655-b6ec-01583f036b2d tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:43.734920 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-04a76046-ac5b-4655-b6ec-01583f036b2d tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1511 microversion: 2.1 time: 0.097017 Sep 15 07:49:43.735582 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 562/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:43 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:43.758805 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-3c0ae5f4-f5fe-4ad0-9752-562475b972ac req-b465d6d5-24d2-4761-aa55-aa7e49a7a2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533c974f-14a5-43e3-a746-c3156eae4282", "name": "network-vif-deleted", "tag": "9499e9bc-c07e-4389-a2e2-415f7d2c8088"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:49:43.768813 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-3c0ae5f4-f5fe-4ad0-9752-562475b972ac req-b465d6d5-24d2-4761-aa55-aa7e49a7a2ea service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:43.769385 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-3c0ae5f4-f5fe-4ad0-9752-562475b972ac req-b465d6d5-24d2-4761-aa55-aa7e49a7a2ea service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:43.769846 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-3c0ae5f4-f5fe-4ad0-9752-562475b972ac req-b465d6d5-24d2-4761-aa55-aa7e49a7a2ea service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:43.782791 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-3c0ae5f4-f5fe-4ad0-9752-562475b972ac req-b465d6d5-24d2-4761-aa55-aa7e49a7a2ea service nova] Creating event network-vif-deleted:9499e9bc-c07e-4389-a2e2-415f7d2c8088 for instance 533c974f-14a5-43e3-a746-c3156eae4282 on hv-cinder-82414 Sep 15 07:49:43.788395 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-3c0ae5f4-f5fe-4ad0-9752-562475b972ac req-b465d6d5-24d2-4761-aa55-aa7e49a7a2ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039725 Sep 15 07:49:43.789208 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 551/1113] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:49:44.758391 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:44.759049 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:44.766704 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:44.767191 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:44.767625 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:44.768324 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:44.768803 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:44.769266 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:44.805077 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:44.805561 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:44.806022 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:44.806479 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lazy-loading 'fault' on Instance uuid 533c974f-14a5-43e3-a746-c3156eae4282 {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:49:44.851423 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4c762318a844714b585f80fdfa9ef53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00091272c5a745f2bf80723a69fbfc61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:49:44.858833 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-8d62f5c4-eabf-4a00-927a-7bce39e5d254 tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 200 len: 1347 microversion: 2.1 time: 0.104461 Sep 15 07:49:44.859412 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 563/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:44 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 1347 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:49:45.883745 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:45.884884 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] [instance: 533c974f-14a5-43e3-a746-c3156eae4282] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:49:45.892142 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:45.892632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:45.893074 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:45.893801 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:49:45.894260 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:49:45.894684 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:49:45.908180 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] HTTP exception thrown: Instance 533c974f-14a5-43e3-a746-c3156eae4282 could not be found. Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Request method failure captured: Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 HTTP/1.1 Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItiQG4TQ5nhEp9hO4sylJGQTArP70SF0UhqrRGFMxWCDuzI6bU6peOsGwojHf1bfmNA5T3kuB5kmgO-kviDaDbwCT1qZOzTVt2dRJo82eMUeUrc_3pXHmYET9KZCQquw9fkXlQnbJz9e86Tobl5buPsOy1cvqhAz1nYANJrnV768VGg Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: 00091272c5a745f2bf80723a69fbfc61 Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-TestMinimumBasicScenario-1849070686 Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:49:45.909876 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_00091272c5a745f2bf80723a69fbfc61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/00091272c5a745f2bf80723a69fbfc61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/00091272c5a745f2bf80723a69fbfc61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/00091272c5a745f2bf80723a69fbfc61"}]}] Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-TestMinimumBasicScenario-1849070686 Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: 00091272c5a745f2bf80723a69fbfc61 Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1849070686 Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-TestMinimumBasicScenario-1849070686-project Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: f4c762318a844714b585f80fdfa9ef53 Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-TestMinimumBasicScenario-1849070686-project Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 533c974f-14a5-43e3-a746-c3156eae4282 could not be found. Sep 15 07:49:45.914769 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '533c974f-14a5-43e3-a746-c3156eae4282'} Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533c974f-14a5-43e3-a746-c3156eae4282 could not be found. Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:49:45.915718 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533c974f-14a5-43e3-a746-c3156eae4282 could not be found. Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533c974f-14a5-43e3-a746-c3156eae4282 could not be found. Sep 15 07:49:45.917354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:49:45.918780 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Returning 404 to user: Instance 533c974f-14a5-43e3-a746-c3156eae4282 could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:49:45.918780 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-01287988-4a96-484d-824d-5744166e01fc tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282" status: 404 len: 111 microversion: 2.1 time: 0.033108 Sep 15 07:49:45.918780 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 552/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:49:45 2022] GET /compute/v2.1/servers/533c974f-14a5-43e3-a746-c3156eae4282 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:49:45.920760 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-d4e1eadc-e8d5-42c0-9dd1-b220f3321a2c tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] Calling method '.version_select at 0x7ff36d4e23a0>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:49:46.030961 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-d4e1eadc-e8d5-42c0-9dd1-b220f3321a2c tempest-TestMinimumBasicScenario-1849070686 tempest-TestMinimumBasicScenario-1849070686-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-766509561" status: 202 len: 0 microversion: 2.1 time: 0.114003 Sep 15 07:49:46.031564 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 564/1116] 10.222.0.42 () {58 vars in 1269 bytes} [Thu Sep 15 07:49:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-766509561 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:50:04.995780 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-cf361426-4013-4528-b0c6-898c92fc86b1 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:04.996298 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-cf361426-4013-4528-b0c6-898c92fc86b1 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:04.998444 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:50:04.999105 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG dbcounter [-] [132673] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132673) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:50:05.003814 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf361426-4013-4528-b0c6-898c92fc86b1 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:05.004300 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf361426-4013-4528-b0c6-898c92fc86b1 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:05.004742 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf361426-4013-4528-b0c6-898c92fc86b1 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:05.005435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf361426-4013-4528-b0c6-898c92fc86b1 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:05.013761 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf361426-4013-4528-b0c6-898c92fc86b1 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:05.013761 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-cf361426-4013-4528-b0c6-898c92fc86b1 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:05.029512 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-cf361426-4013-4528-b0c6-898c92fc86b1 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/ips" status: 200 len: 146 microversion: 2.1 time: 0.037735 Sep 15 07:50:05.030104 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 553/1117] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 15 07:50:04 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 07:50:06.659197 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=15 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:50:06.659980 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:50:06.665312 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fe90d53c-b674-4f77-8f96-d26d9456141e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29c8c5fe-54df-4e2f-9280-bfa18596417b"}} {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:50:06.667702 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-fe90d53c-b674-4f77-8f96-d26d9456141e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:06.674488 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe90d53c-b674-4f77-8f96-d26d9456141e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:06.674988 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe90d53c-b674-4f77-8f96-d26d9456141e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:06.675436 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe90d53c-b674-4f77-8f96-d26d9456141e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:06.676132 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe90d53c-b674-4f77-8f96-d26d9456141e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:06.676591 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe90d53c-b674-4f77-8f96-d26d9456141e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:06.677024 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fe90d53c-b674-4f77-8f96-d26d9456141e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:07.337327 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fe90d53c-b674-4f77-8f96-d26d9456141e tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "POST /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.679377 Sep 15 07:50:07.337962 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 565/1118] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:50:06 2022] POST /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments => generated 194 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:50:14.870738 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ea9ca1a0-7c95-4b90-bcad-23fec35d08c5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:14.872868 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ea9ca1a0-7c95-4b90-bcad-23fec35d08c5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:14.881145 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ea9ca1a0-7c95-4b90-bcad-23fec35d08c5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:14.881653 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ea9ca1a0-7c95-4b90-bcad-23fec35d08c5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:14.882080 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ea9ca1a0-7c95-4b90-bcad-23fec35d08c5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:14.882761 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ea9ca1a0-7c95-4b90-bcad-23fec35d08c5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:14.883209 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ea9ca1a0-7c95-4b90-bcad-23fec35d08c5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:14.883627 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ea9ca1a0-7c95-4b90-bcad-23fec35d08c5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:14.913470 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ea9ca1a0-7c95-4b90-bcad-23fec35d08c5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046621 Sep 15 07:50:14.914043 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 554/1119] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:50:14 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:50:14.926008 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-11a428a6-33e9-49ec-95e2-c1706d3274e5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:14.926594 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-11a428a6-33e9-49ec-95e2-c1706d3274e5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:14.932931 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11a428a6-33e9-49ec-95e2-c1706d3274e5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:14.933411 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11a428a6-33e9-49ec-95e2-c1706d3274e5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:14.933869 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11a428a6-33e9-49ec-95e2-c1706d3274e5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:14.934558 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11a428a6-33e9-49ec-95e2-c1706d3274e5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:14.935014 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11a428a6-33e9-49ec-95e2-c1706d3274e5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:14.935439 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-11a428a6-33e9-49ec-95e2-c1706d3274e5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:14.965726 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-11a428a6-33e9-49ec-95e2-c1706d3274e5 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments/29c8c5fe-54df-4e2f-9280-bfa18596417b" status: 200 len: 194 microversion: 2.1 time: 0.044399 Sep 15 07:50:14.966316 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 566/1120] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Sep 15 07:50:14 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments/29c8c5fe-54df-4e2f-9280-bfa18596417b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:50:16.579903 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ad023a36-729b-4358-adf6-8dd54fe9ccd6 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20e78e14-bb1d-43d3-b2e0-d01056a7ebb4"}} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:50:16.582225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ad023a36-729b-4358-adf6-8dd54fe9ccd6 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:16.589654 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad023a36-729b-4358-adf6-8dd54fe9ccd6 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:16.590141 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad023a36-729b-4358-adf6-8dd54fe9ccd6 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:16.590577 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad023a36-729b-4358-adf6-8dd54fe9ccd6 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:16.591262 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad023a36-729b-4358-adf6-8dd54fe9ccd6 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:16.591716 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad023a36-729b-4358-adf6-8dd54fe9ccd6 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:16.592169 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ad023a36-729b-4358-adf6-8dd54fe9ccd6 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:17.273966 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ad023a36-729b-4358-adf6-8dd54fe9ccd6 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "POST /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.698385 Sep 15 07:50:17.274567 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 555/1121] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 15 07:50:16 2022] POST /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:50:24.806014 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-efac2ad6-10e0-40e2-b1b3-74b75b679bbf tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:24.808547 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-efac2ad6-10e0-40e2-b1b3-74b75b679bbf tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:24.815051 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efac2ad6-10e0-40e2-b1b3-74b75b679bbf tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:24.815528 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efac2ad6-10e0-40e2-b1b3-74b75b679bbf tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:24.815957 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efac2ad6-10e0-40e2-b1b3-74b75b679bbf tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:24.816640 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efac2ad6-10e0-40e2-b1b3-74b75b679bbf tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:24.817087 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efac2ad6-10e0-40e2-b1b3-74b75b679bbf tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:24.817507 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-efac2ad6-10e0-40e2-b1b3-74b75b679bbf tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:24.851178 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-efac2ad6-10e0-40e2-b1b3-74b75b679bbf tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049709 Sep 15 07:50:24.851752 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 567/1122] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:50:24 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:50:24.999199 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-9c4ef1e9-cd5d-48b0-bcfa-b2794e907a49 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:24.999776 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-9c4ef1e9-cd5d-48b0-bcfa-b2794e907a49 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:25.006550 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4ef1e9-cd5d-48b0-bcfa-b2794e907a49 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:25.007025 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4ef1e9-cd5d-48b0-bcfa-b2794e907a49 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:25.007458 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4ef1e9-cd5d-48b0-bcfa-b2794e907a49 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:25.008144 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4ef1e9-cd5d-48b0-bcfa-b2794e907a49 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:25.008597 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4ef1e9-cd5d-48b0-bcfa-b2794e907a49 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:25.009023 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-9c4ef1e9-cd5d-48b0-bcfa-b2794e907a49 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:25.036712 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-9c4ef1e9-cd5d-48b0-bcfa-b2794e907a49 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments/29c8c5fe-54df-4e2f-9280-bfa18596417b" status: 200 len: 194 microversion: 2.1 time: 0.042296 Sep 15 07:50:25.037283 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 556/1123] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Sep 15 07:50:24 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments/29c8c5fe-54df-4e2f-9280-bfa18596417b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:50:25.047560 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-c53ee03c-31a7-466e-8ca6-76d73f796599 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:25.048159 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-c53ee03c-31a7-466e-8ca6-76d73f796599 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:25.054815 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c53ee03c-31a7-466e-8ca6-76d73f796599 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:25.055306 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c53ee03c-31a7-466e-8ca6-76d73f796599 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:25.055747 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c53ee03c-31a7-466e-8ca6-76d73f796599 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:25.056442 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c53ee03c-31a7-466e-8ca6-76d73f796599 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:25.056901 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c53ee03c-31a7-466e-8ca6-76d73f796599 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:25.057333 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-c53ee03c-31a7-466e-8ca6-76d73f796599 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:25.136660 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-c53ee03c-31a7-466e-8ca6-76d73f796599 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lazy-loading 'services' on Instance uuid e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:50:25.376503 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-c53ee03c-31a7-466e-8ca6-76d73f796599 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments/29c8c5fe-54df-4e2f-9280-bfa18596417b" status: 202 len: 0 microversion: 2.1 time: 0.332677 Sep 15 07:50:25.377094 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 568/1124] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:50:25 2022] DELETE /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments/29c8c5fe-54df-4e2f-9280-bfa18596417b => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:50:26.497274 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-186264e0-1f7a-497e-af38-284f16cfb1dd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:26.497847 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-186264e0-1f7a-497e-af38-284f16cfb1dd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:26.504379 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-186264e0-1f7a-497e-af38-284f16cfb1dd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:26.504905 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-186264e0-1f7a-497e-af38-284f16cfb1dd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:26.505377 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-186264e0-1f7a-497e-af38-284f16cfb1dd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:26.506141 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-186264e0-1f7a-497e-af38-284f16cfb1dd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:26.506658 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-186264e0-1f7a-497e-af38-284f16cfb1dd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:26.507122 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-186264e0-1f7a-497e-af38-284f16cfb1dd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:26.543381 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-186264e0-1f7a-497e-af38-284f16cfb1dd tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments/20e78e14-bb1d-43d3-b2e0-d01056a7ebb4" status: 200 len: 194 microversion: 2.1 time: 0.050125 Sep 15 07:50:26.543983 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 557/1125] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Sep 15 07:50:26 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments/20e78e14-bb1d-43d3-b2e0-d01056a7ebb4 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:50:26.556137 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-e279aa89-0f52-4cd3-96b8-49b3b74d9f68 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:26.556775 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-e279aa89-0f52-4cd3-96b8-49b3b74d9f68 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:26.562860 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e279aa89-0f52-4cd3-96b8-49b3b74d9f68 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:26.563346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e279aa89-0f52-4cd3-96b8-49b3b74d9f68 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:26.568793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e279aa89-0f52-4cd3-96b8-49b3b74d9f68 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:26.568793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e279aa89-0f52-4cd3-96b8-49b3b74d9f68 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:26.568793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e279aa89-0f52-4cd3-96b8-49b3b74d9f68 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:26.568793 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-e279aa89-0f52-4cd3-96b8-49b3b74d9f68 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:26.645460 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-e279aa89-0f52-4cd3-96b8-49b3b74d9f68 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lazy-loading 'services' on Instance uuid e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:50:26.833725 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-e279aa89-0f52-4cd3-96b8-49b3b74d9f68 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments/20e78e14-bb1d-43d3-b2e0-d01056a7ebb4" status: 202 len: 0 microversion: 2.1 time: 0.282772 Sep 15 07:50:26.834308 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 569/1126] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 15 07:50:26 2022] DELETE /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments/20e78e14-bb1d-43d3-b2e0-d01056a7ebb4 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:50:28.009357 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-75a0057c-afbc-4c4a-b59e-f7d0bfc3c9cc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:28.011632 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-75a0057c-afbc-4c4a-b59e-f7d0bfc3c9cc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:28.018268 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75a0057c-afbc-4c4a-b59e-f7d0bfc3c9cc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:28.018759 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75a0057c-afbc-4c4a-b59e-f7d0bfc3c9cc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:28.019198 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75a0057c-afbc-4c4a-b59e-f7d0bfc3c9cc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:28.019897 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75a0057c-afbc-4c4a-b59e-f7d0bfc3c9cc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:28.020354 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75a0057c-afbc-4c4a-b59e-f7d0bfc3c9cc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:28.020786 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-75a0057c-afbc-4c4a-b59e-f7d0bfc3c9cc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:28.053437 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-75a0057c-afbc-4c4a-b59e-f7d0bfc3c9cc tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048023 Sep 15 07:50:28.054018 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 558/1127] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:50:28 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 07:50:28.178630 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-f3d4ca02-f2c4-4168-85c9-c5902151b091 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:28.181044 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-f3d4ca02-f2c4-4168-85c9-c5902151b091 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:28.187185 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3d4ca02-f2c4-4168-85c9-c5902151b091 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:28.187681 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3d4ca02-f2c4-4168-85c9-c5902151b091 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:28.188124 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3d4ca02-f2c4-4168-85c9-c5902151b091 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:28.188820 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3d4ca02-f2c4-4168-85c9-c5902151b091 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:28.189280 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3d4ca02-f2c4-4168-85c9-c5902151b091 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:28.189753 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-f3d4ca02-f2c4-4168-85c9-c5902151b091 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:28.218918 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-f3d4ca02-f2c4-4168-85c9-c5902151b091 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045407 Sep 15 07:50:28.219494 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 570/1128] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 15 07:50:28 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 07:50:28.284436 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-ae91c741-421c-42ed-b1d7-ff72dc9f7c66 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:28.284927 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ae91c741-421c-42ed-b1d7-ff72dc9f7c66 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:28.291408 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae91c741-421c-42ed-b1d7-ff72dc9f7c66 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:28.291886 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae91c741-421c-42ed-b1d7-ff72dc9f7c66 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:28.292317 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae91c741-421c-42ed-b1d7-ff72dc9f7c66 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:28.292994 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae91c741-421c-42ed-b1d7-ff72dc9f7c66 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:28.293443 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae91c741-421c-42ed-b1d7-ff72dc9f7c66 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:28.293892 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-ae91c741-421c-42ed-b1d7-ff72dc9f7c66 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:28.318256 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-ae91c741-421c-42ed-b1d7-ff72dc9f7c66 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Going to try to terminate instance {{(pid=132673) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 15 07:50:28.587435 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-ae91c741-421c-42ed-b1d7-ff72dc9f7c66 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 204 len: 0 microversion: 2.1 time: 0.306418 Sep 15 07:50:28.588065 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 559/1129] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:50:28 2022] DELETE /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 07:50:28.596327 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-61edf28b-fea1-4b74-91b8-8c8f6d7ee377 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:28.596973 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-61edf28b-fea1-4b74-91b8-8c8f6d7ee377 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:28.603238 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-61edf28b-fea1-4b74-91b8-8c8f6d7ee377 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:28.603711 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-61edf28b-fea1-4b74-91b8-8c8f6d7ee377 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:28.604283 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-61edf28b-fea1-4b74-91b8-8c8f6d7ee377 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:28.605016 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-61edf28b-fea1-4b74-91b8-8c8f6d7ee377 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:28.605475 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-61edf28b-fea1-4b74-91b8-8c8f6d7ee377 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:28.605933 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-61edf28b-fea1-4b74-91b8-8c8f6d7ee377 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:28.738914 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-61edf28b-fea1-4b74-91b8-8c8f6d7ee377 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:50:28.746766 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-61edf28b-fea1-4b74-91b8-8c8f6d7ee377 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1674 microversion: 2.1 time: 0.154456 Sep 15 07:50:28.747334 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 571/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:50:28 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:50:29.772019 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-828ffac7-0f0a-44f3-bae5-4e536a6d31d4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:29.772725 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-828ffac7-0f0a-44f3-bae5-4e536a6d31d4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:29.779341 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-828ffac7-0f0a-44f3-bae5-4e536a6d31d4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:29.779829 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-828ffac7-0f0a-44f3-bae5-4e536a6d31d4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:29.780263 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-828ffac7-0f0a-44f3-bae5-4e536a6d31d4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:29.780954 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-828ffac7-0f0a-44f3-bae5-4e536a6d31d4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:29.781410 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-828ffac7-0f0a-44f3-bae5-4e536a6d31d4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:29.781865 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-828ffac7-0f0a-44f3-bae5-4e536a6d31d4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:29.920000 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.policy [None req-828ffac7-0f0a-44f3-bae5-4e536a6d31d4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132673) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:50:29.928028 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-828ffac7-0f0a-44f3-bae5-4e536a6d31d4 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1674 microversion: 2.1 time: 0.161072 Sep 15 07:50:29.928620 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 560/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:50:29 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:50:30.951694 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-3a599871-1c88-4be8-a19e-e513875cf9ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:30.952443 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-3a599871-1c88-4be8-a19e-e513875cf9ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:30.960281 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a599871-1c88-4be8-a19e-e513875cf9ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:30.960765 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a599871-1c88-4be8-a19e-e513875cf9ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:30.961200 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a599871-1c88-4be8-a19e-e513875cf9ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:30.961927 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a599871-1c88-4be8-a19e-e513875cf9ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:30.962381 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a599871-1c88-4be8-a19e-e513875cf9ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:30.962816 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-3a599871-1c88-4be8-a19e-e513875cf9ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:31.092343 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-3a599871-1c88-4be8-a19e-e513875cf9ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:50:31.100561 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-3a599871-1c88-4be8-a19e-e513875cf9ae tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1674 microversion: 2.1 time: 0.152708 Sep 15 07:50:31.101130 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 572/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:50:30 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:50:31.398772 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [req-e2e1870e-b790-435b-932e-a9fa76b5a7ec req-44937023-4a5b-4d3b-9a8f-f2ed01a73ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd", "name": "network-vif-deleted", "tag": "a9942a95-f13c-4b93-b3ea-9e337fbfb77e"}]} {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 07:50:31.408628 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-e2e1870e-b790-435b-932e-a9fa76b5a7ec req-44937023-4a5b-4d3b-9a8f-f2ed01a73ee8 service nova] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:31.409616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-e2e1870e-b790-435b-932e-a9fa76b5a7ec req-44937023-4a5b-4d3b-9a8f-f2ed01a73ee8 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:31.409616 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [req-e2e1870e-b790-435b-932e-a9fa76b5a7ec req-44937023-4a5b-4d3b-9a8f-f2ed01a73ee8 service nova] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:31.421271 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.compute.server_external_events [req-e2e1870e-b790-435b-932e-a9fa76b5a7ec req-44937023-4a5b-4d3b-9a8f-f2ed01a73ee8 service nova] Creating event network-vif-deleted:a9942a95-f13c-4b93-b3ea-9e337fbfb77e for instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd on hv-cinder-82414 Sep 15 07:50:31.426174 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [req-e2e1870e-b790-435b-932e-a9fa76b5a7ec req-44937023-4a5b-4d3b-9a8f-f2ed01a73ee8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031452 Sep 15 07:50:31.426758 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 561/1133] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 15 07:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 07:50:32.124465 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:32.125082 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:32.132261 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:32.132746 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:32.133291 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:32.134036 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:32.134488 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:32.134907 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:32.168158 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:32.168638 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:32.169069 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:32.169516 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.objects.instance [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lazy-loading 'fault' on Instance uuid e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd {{(pid=132674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 15 07:50:32.213121 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.policy [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8022d5f904e4ae294b2cdf21aa11212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d0f5e6d6cf423485157e1381a12713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132674) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 07:50:32.221203 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-36fa33b5-6b78-477c-ae2d-486751e40dac tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 200 len: 1328 microversion: 2.1 time: 0.100618 Sep 15 07:50:32.221817 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 573/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:50:32 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 07:50:33.245994 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:33.246629 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:33.252749 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:33.253225 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:33.253688 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:33.254370 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:33.254819 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:33.256064 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:33.268923 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] HTTP exception thrown: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Request method failure captured: Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd HTTP/1.1 Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItg8dqvWN2t91HpO2f1YgToZu8w4RXinF2BJUSaUxJDZILTvoIqWwrZAuG81WEJZdbQvkfFMGoH7t_M8zwldYxG_Y6kGvGJ6nxMgqfPPRxnS76wTvF17OM-NA7cc5Bdk_BXPdXeuDTxw3fpdKmqB0e464twrvADIGpxET9k0DWHkyyg Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:50:33.270547 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a9d0f5e6d6cf423485157e1381a12713"}]}] Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: f8022d5f904e4ae294b2cdf21aa11212 Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:33.272287 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': 'e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd'} Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:50:33.273280 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:33.274916 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:33.276368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Returning 404 to user: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:50:33.276368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-41205a4b-f995-47db-ac1a-44127c3cb1d8 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 404 len: 111 microversion: 2.1 time: 0.030764 Sep 15 07:50:33.276368 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 562/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:50:33 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:50:33.280535 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-6b667108-ce2e-40dd-a6f0-640f6e529860 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '.version_select at 0x7ff36cbec700>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:33.343789 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-6b667108-ce2e-40dd-a6f0-640f6e529860 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021748343" status: 202 len: 0 microversion: 2.1 time: 0.066932 Sep 15 07:50:33.344346 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 574/1136] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Sep 15 07:50:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021748343 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 07:50:36.573173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:36.573716 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:36.580220 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:36.580705 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:36.581142 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:36.581858 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:36.582321 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:36.582750 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:36.596751 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] HTTP exception thrown: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Request method failure captured: Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: DELETE /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd HTTP/1.1 Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItg8dqvWN2t91HpO2f1YgToZu8w4RXinF2BJUSaUxJDZILTvoIqWwrZAuG81WEJZdbQvkfFMGoH7t_M8zwldYxG_Y6kGvGJ6nxMgqfPPRxnS76wTvF17OM-NA7cc5Bdk_BXPdXeuDTxw3fpdKmqB0e464twrvADIGpxET9k0DWHkyyg Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:50:36.598344 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a9d0f5e6d6cf423485157e1381a12713"}]}] Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: f8022d5f904e4ae294b2cdf21aa11212 Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:36.600173 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': 'e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd'} Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:50:36.601149 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:36.602763 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:36.604289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Returning 404 to user: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:50:36.604289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-eaf39d34-9f23-4faa-a9ca-abaa65720e59 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 404 len: 111 microversion: 2.1 time: 0.030366 Sep 15 07:50:36.604289 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 563/1137] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:50:36 2022] DELETE /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:50:36.608117 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:36.608735 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:36.619242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:36.619242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:36.619242 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:36.630293 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:36.630293 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:36.630293 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:36.634881 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] HTTP exception thrown: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Request method failure captured: Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd HTTP/1.1 Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItg8dqvWN2t91HpO2f1YgToZu8w4RXinF2BJUSaUxJDZILTvoIqWwrZAuG81WEJZdbQvkfFMGoH7t_M8zwldYxG_Y6kGvGJ6nxMgqfPPRxnS76wTvF17OM-NA7cc5Bdk_BXPdXeuDTxw3fpdKmqB0e464twrvADIGpxET9k0DWHkyyg Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:50:36.636549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a9d0f5e6d6cf423485157e1381a12713"}]}] Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: f8022d5f904e4ae294b2cdf21aa11212 Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:36.638219 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': 'e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd'} Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:50:36.639183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. Sep 15 07:50:36.640709 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:50:36.642241 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Returning 404 to user: Instance e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:50:36.642241 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-412fcea7-e7fd-46f0-89e9-52e19ec68056 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd" status: 404 len: 111 microversion: 2.1 time: 0.033726 Sep 15 07:50:36.642241 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 575/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:50:36 2022] GET /compute/v2.1/servers/e82d95c9-8eb8-4c77-b1fc-2e31d7466bbd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:50:37.875279 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:37.875786 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.compute.api [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132673) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:37.882866 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:37.883352 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:37.883789 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:37.884481 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:37.884940 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:37.885369 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG oslo_concurrency.lockutils [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132673) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:37.900466 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.wsgi [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] HTTP exception thrown: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Request method failure captured: Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: request: DELETE /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec HTTP/1.1 Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept: application/json Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Accept-Encoding: identity Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Connection: close Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Length: 0 Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Content-Type: application/json Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Host: 10.222.0.42 Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: Openstack-System-Scope: None Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: User-Agent: python-urllib3/1.26.12 Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Auth-Token: gAAAAABjItg8dqvWN2t91HpO2f1YgToZu8w4RXinF2BJUSaUxJDZILTvoIqWwrZAuG81WEJZdbQvkfFMGoH7t_M8zwldYxG_Y6kGvGJ6nxMgqfPPRxnS76wTvF17OM-NA7cc5Bdk_BXPdXeuDTxw3fpdKmqB0e464twrvADIGpxET9k0DWHkyyg Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Id: None Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Domain-Name: None Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Identity-Status: Confirmed Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Is-Admin-Project: True Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Id: default Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Domain-Name: Default Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Project-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Role: reader,member Sep 15 07:50:37.902029 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Roles: reader,member Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a9d0f5e6d6cf423485157e1381a12713"}]}] Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Id: default Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Domain-Name: Default Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Id: f8022d5f904e4ae294b2cdf21aa11212 Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: X-User-Name: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: method: > Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: exception: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:50:37.903739 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: action_args: {'id': '30ed5535-17bd-48d9-b6b5-ba296066b7ec'} Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: {{(pid=132673) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:50:37.904674 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:50:37.906340 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: ERROR nova.api.openstack.wsgi Sep 15 07:50:37.907893 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: DEBUG nova.api.openstack.wsgi [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Returning 404 to user: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. {{(pid=132673) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:50:37.907893 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: INFO nova.api.openstack.requestlog [None req-d31e59dc-871d-4b21-b122-5699f282d092 tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "DELETE /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 404 len: 111 microversion: 2.1 time: 0.031977 Sep 15 07:50:37.907893 dv-cinder-824149-6-iscsi devstack@n-api.service[132673]: [pid: 132673|app: 0|req: 564/1139] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 15 07:50:37 2022] DELETE /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 07:50:37.911915 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Calling method '>' {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 07:50:37.912549 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.compute.api [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] [instance: 30ed5535-17bd-48d9-b6b5-ba296066b7ec] Fetching instance by UUID {{(pid=132674) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 15 07:50:37.914972 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:50:37.919601 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:37.920076 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:37.920505 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:37.921183 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Acquiring lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 15 07:50:37.921653 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 15 07:50:37.922113 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG oslo_concurrency.lockutils [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Lock "72faee06-56dc-4608-aa3b-e80f5a9bf08f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 15 07:50:37.924852 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG dbcounter [-] [132674] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=132674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 07:50:37.936699 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.wsgi [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] HTTP exception thrown: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Request method failure captured: Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: request: GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec HTTP/1.1 Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept: application/json Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Accept-Encoding: identity Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Connection: close Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Length: 0 Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Content-Type: application/json Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Host: 10.222.0.42 Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: Openstack-System-Scope: None Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: User-Agent: python-urllib3/1.26.12 Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Auth-Token: gAAAAABjItg8dqvWN2t91HpO2f1YgToZu8w4RXinF2BJUSaUxJDZILTvoIqWwrZAuG81WEJZdbQvkfFMGoH7t_M8zwldYxG_Y6kGvGJ6nxMgqfPPRxnS76wTvF17OM-NA7cc5Bdk_BXPdXeuDTxw3fpdKmqB0e464twrvADIGpxET9k0DWHkyyg Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Id: None Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Domain-Name: None Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Identity-Status: Confirmed Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Is-Admin-Project: True Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Id: default Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Domain-Name: Default Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Project-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Role: reader,member Sep 15 07:50:37.938246 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Roles: reader,member Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a9d0f5e6d6cf423485157e1381a12713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a9d0f5e6d6cf423485157e1381a12713"}]}] Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Id: a9d0f5e6d6cf423485157e1381a12713 Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2088799824 Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Id: default Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Domain-Name: Default Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Id: f8022d5f904e4ae294b2cdf21aa11212 Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: X-User-Name: tempest-AttachVolumeTestJSON-2088799824-project Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: method: > Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: exception: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:50:37.940597 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: action_args: {'id': '30ed5535-17bd-48d9-b6b5-ba296066b7ec'} Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: {{(pid=132674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 15 07:50:37.941648 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. Sep 15 07:50:37.943876 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: ERROR nova.api.openstack.wsgi Sep 15 07:50:37.947158 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: DEBUG nova.api.openstack.wsgi [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] Returning 404 to user: Instance 30ed5535-17bd-48d9-b6b5-ba296066b7ec could not be found. {{(pid=132674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 15 07:50:37.947158 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: INFO nova.api.openstack.requestlog [None req-fa81a5e5-e03b-4892-8de8-3cf2a1e7030c tempest-AttachVolumeTestJSON-2088799824 tempest-AttachVolumeTestJSON-2088799824-project] 10.222.0.42 "GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec" status: 404 len: 111 microversion: 2.1 time: 0.031615 Sep 15 07:50:37.947158 dv-cinder-824149-6-iscsi devstack@n-api.service[132674]: [pid: 132674|app: 0|req: 576/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 15 07:50:37 2022] GET /compute/v2.1/servers/30ed5535-17bd-48d9-b6b5-ba296066b7ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0)